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I.  INTRODUCTION 

The  primary  advantage  of  optical  processing  systems  Is  their  parallel 

3  3 

processing  capability.  Typically  10  xIO  analog  data  points  can  be  processed 
simultaneously.  Furthermore  the  optical  system  has  maximum  Interconnection 
capability,  allowing  each  data  point  from  the  Input  plane  to  be  multiplied 
with  all  the  10  xIO  data  points  stored  In  the  frequency  plane  of  a  •'conventional 
Vender  Lugt  correlator  [1].  This  leads  to  the  computation  of  10  analog 
multiplications  In  the  time  It  takes  for  light  to  propagate  from  the  Input  to 
the  output  plane.  The  extremely  high  processing  power  of  the  optical  system 
can  only  be  realized  In  practice  If  suitable  input/output  devices  exist.  Two 
dimensional  spatial  light  modulators  [2,3]  remain  the  major  factor  limiting 
the  speed  and  the  accuracy  of  the  optical  processors  they  are  part  of.  Acousto- 
optic  devices  (AODs)  have  emerged  In  recent  years  as  high  quality,  wideband 

Q 

(10  Hz)  light  modulators  and  consequently  they  have  been  extensively  used  as 
the  Input  transducer  In  1-D  optical  signal  processors  [4].  A  relative  dis¬ 
advantage  of  AOD's  Is  that  they  are  1-D  light  modulators  with  a  linear  space 
bandwidth  product  of  approximately  10  .  The  typical  images  that  we  like  to  be 
able  to  process  optically  have  at  least  10  xIO  pixels  (more  typically  10  xIO  ) 
and  AODs  cannot  represent  an  entire  Image  simultaneously.  To  overcome  this 
difficulty,  only  a  portion  (a  line)  of  an  Image  Is  entered  Into  the  optical 
processor  at  one  time  and  is  processed  separately.  The  Intermediate  results 
are  temporarily  stored  on  a  2-D  optical  detector  (In  the  form  of  photogenerated 
charge)  and  allowed  to  accumulate  on  the  detector  until  all  the  lines  of  the 
Input  Image  have  been  entered  and  processed.  He  will  show  In  the  next  chapter 
that  2-D  linear  operations  can  be  performed  In  this  manner.  If  the  kernel  Is 
shift  Invariant  or  separable  In  the  two  coordinates.  This  processing  method 


Is  called  time  and  space  Integrating  [5,6,7],  since  each  line  of  data  Is 
processed  by  space  Integration  and  the  final  result  Is  produced  by  Integrating 
in  time  on  the  detector.  The  spatial  Integrating  part  of  the  processor 

Q 

operates  at  the  very  high  bandwidth  of  the  acousto-optic  device  (up  to  10  Hz) 
while  the  time  Integrating  processor  serves  as  a  convenient  Intermediate  storage 
and  data  manager.  Data  Is  produced  by  the  space  Integrating  processor  at 
extremely  high  rates  (typically  higher  than  1010  analog  samples/second).  The 
time  Integration  compresses  this  rate  to  a  manageable  107  samples/second  and 
in  the  process  a  useful  signal  processing  operation  Is  performed. 

There  are  two  main  factors  that  we  feel  make  tlme-and  space  Integrating 
attractive.  Firstly,  since  the  processing  Is  performed  In  the  time  domain  there 
Is  Increased  flexibility  (perhaps  we  can  call  It  programmability)  In  controlling 
the  flow  of  data  through  the  processor  and  the  operations  that  are  being  per¬ 
formed.  The  second,  and  perhaps  most  Important  factor.  Is  the  Implementation 
of  these  architectures  with  well  developed  devices  (AODs,  laser  diodes,  CCD 
arrays)  which  can  lead  to  the  development  of  practical  (compact, Inexpensive  and 
power/efficlent)  powerful  2-D  optical  processors.  The  state  of  the  art  and  the 
experimental  characterization  of  the  devices  we  use, are  presented  In  Chapter  III. 

The  price  that  we  must  pay  for  the  convenience  of  using  the  optical  detector 
as  an  accumulator  Is  the  bias  built-up  problem  that  Is  always  associated  with 
temporal  Integration.  The  problem  arises  because  we  wish  to  represent  bipolar 
signals  by  photo gene rated  charges.  Since  the  photogenerated  charge  Is  propor¬ 
tional  to  light  Intensity,  (a  positive  quantity)  a  bias  Is  Introduced  so  that 
a  positive  signal  on  the  detector  smaller  than  the  bias  level  can  be  Interpreted 
as  a  negative  signal.  The  bias  always  diminishes  the  dynamic  range  with  which 
the  output  can  be  represented.  It  Is  therefore  crucial  to  select  the  optimum 


mode  of  operation  and  minimize  the  bias  built  up.  This  Issue  and  the  closely 
related  subject  of  coherent  vs.  Incoherent  Implementation  are  addressed  In 
chapter  IV. 

Me  mentioned  earlier  that  any  2-D  linear  operation  with  a  separable  or 
shift  Invariant  kernel  can  be  Implemented  with  time  and  space  Integrating 
architectures.  In  principle  then,  these  processors  can  be  applied  to  any 
problem  that  requires  the  computation  of  such  operations.  Each  problem 
however  has  Its  own  pecularltles  and  a  lot  is  gained  by  designing  architec¬ 
tures  specifically  for  a  given  application.  During  this  reporting  period  we 
have  considered  2-D  correlation  [8,9]  the  calculation  of  moments  [10], 
synthetic  aperture  radar  [11,12]  and  2-D  spectrum  analysis  [13],  Architectures 
for  each  of  these  problems  and  initial  experiments  are  presented  In  chapter  V. 
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II.  ARCHITECTURES 

The  TSI  architectures  we  are  Investigating  can  be  described  In  general 
by  the  block  diagram  of  Figure  1. 

*1  (sequential!  (acousto- 

I  =*  RASTER  =»  OPTIC  =» 
y  I  SCANNER  f  | DEVICE 

F(x,v>  F(x,»*y) 

Figure  1.  Time  and  space  Integrating  processing  of 
2-D  signals. 

f(x,y)  Is  the  2-D  data  (usually  an  Image)  on  which  we  will  perform  an  arbltary 
linear  operation: 

g(x,y)  «  J/f(x  y)  h(x,x,y,y)  dxdy.  (1) 

h  Is  the  impulse  response  of  the  linear  operator  and  g  Is  the  output  we  wish 
to  produce.  The  function  f(x,y)  Is  sampled  In  the  y  direction  and  It  Is  scanned 
along  the  x  direction  to  produce  a  temporal  electronic  signal.  If  f(x,y)  Is  an 
Image,  a  TV  camera  performs  this  function  by  producing  the  video  signal.  The 
video  signal  Is  applied  to  an  AOD  where  It  generates  a  travelling  acoustic  wave 
proportional  to  the  video  within  the  acoustic  delay  of  the  AOD.  The  delay  is 
made  to  be  exactly  equal  to  the  duration  of  one  video  line.  At  periodic  time 
Instances  the  acoustic  signal  In  the  AOD  corresponds  to  precisely  one  raster 
line  of  f(x,y).  At  these  Instances  the  AOD  Is  Illuminated  with  a  short  light 
pulse.  The  light  diffracted  by  the  AOD  each  time  the  light  source  Is  pulsed,  is 
spatially  modulated  by  one  of  the  lines  of  f(x,y).  At  periodic  time  Instances 


1-D  SPACE  2-D  TIME 

INTEGRATING  INTEGRATING  6(x,v) 

OPTICAL  PROCESSOR  DETECTOR 


the  light  Is  spatially  modulated  by  consequltive  lines  of  f(x,y).  This 
modulation  scheme  can  be  thought  of  as  spatial  modulation  of  the  light  with 
the  x  variation  of  the  Image  f(x,y)  and  temporal  light  modulation  by  the  y 
variation.  Each  line  of  f(x,y)  denoted  by  f(x,nAy)  Is  processed  by  a  1-0 
multichannel  space  Integrating  optical  processor  whose  operation  Is  described 
by  the  following  equation 

gn(x»y)  *  / f(x.nAy)  h  (x.x.  nAy,y)  dx.  (2) 

The  output  of  this  optical  processor  Is  detected  by  a  2-D  Integrating  CCD 
array  on  which  the  results  from  consequltive  lines  are  accumulated.  After  N 
video  lines  have  been  processed  and  detected,  the  signal  that  Is  accumulated 
Is  given  by 

g(x,y)  ■  r  ff(x,nAy)  h  (x,x,nAy,y)  dx  .  (3) 

n 

This  equation  Is  a  modified  version  of  Eq.  (1),  with  the  Integration 
over  the  continuous  variable  y,  replaced  by  the  summation  over  the  discrete 
variable  nAy. 

The  development  of  Eq.  (3)  suggests  the  method  through  which  it  is  in 
principle  possible  to  Implement  2-D  signal  processing  operations  with  AOD's. 

It  does  not  tell  us  what  linear  operations  are  feasible  and  the  optical 
systems  that  will  Implement  these  operations.  We  spent  considerable  effort 
to  determine  whether  It  Is  possible  to  Implement  the  most  general  2-D  shift 

A  A 

variant  kernel,  h(x,x,y,y).  Our  conclusion  Is  that  there  Is  no  efficient 
method  for  doing  so  and  the  reason  Is  simply  lack  of  enough  independent 

A  A 

dimensions.  The  Implementation  of  a  general  kernel  h(x,x,y,y)  requires  4 
Independent  variables  and  we  have  only  3  (2  spatial  and  time)  to  work  with. 
Therefore,  our  conclusion  Is  that  unless  we  are  willing  to  use  wavelength 
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as ‘a  fourth  variable,  or  temporal /spatial  multiplexing  (solutions  we  consider 
Impractical  at  this  point).  It  is  not  possible  to  Implement  the  most  general 
2-D* linear  operation.  The  two  most  Important  2-D  linear  operations  can  be 
implemented  however:  separable  and  shift-invariant  operations. 

1  A  A  A 

If  the  kernel  Is  separable  (h(x.x.y.y)  «  h^x.x)  h2(y,y)),  Eq.  (3)  takes 
the  following  form. 

5  g(x.y)  *  £  Cff(x.nAy)  h.  (x,x)  dx]  h?  (nAy.y).  (4) 

n 

This  type  of  operation  can  be  Implemented  with  a  cascade  of  1-0  time  and  space 
integrating  processors  operating  In  orthogonal  spatial  dimensions.  The  orthogo¬ 
nality  of  the  spatial  domains  of  the  two  processors  implies  that  they  operate 
Independently  (they  do  not  have  to  be  coupled,  simply  Interfaced)  and  therefore 
their  Implementation  is  relative  straightforward.  Arbitary  space-variant 
separable  kernels  can  be  Implemented  with  the  TSI  method.  One  possible  implemen¬ 
tation  of  a  general  space-variant  separable  kernel  processor  Is  shown  in  Figure 
2'.e  The  Input  Image  f(x,y)  Is  applied  to  A0D1  as  a  TV  video  signal.  Each  line 
of' the  Input  image  Is  processed  In  the  x  dimension  by  an  astigmatic  1-D  space 
variant  processor  (vector-matrix  multiplier  [14]).  This  portion  of  the  processor 
Implements  the  Integration  over  x  In  equation  (4)  and  produces  the  result  In  the 
foVro  of  a  beam  modulated  spatially  In  the  vertical  direction.  A  second  AOD  is 
placed  In  the  horizontal  direction.  This  AOD  modulates  the  light  from  the 

;/  a 

astigmatic  processor  by  the  nth  line  of  the  functon  h2  (x,y)  (h2(nAy,y))  at  the 
Instant  the  nth  line  of  the  Input  function  f(x,y)  is  In  the  first  AOD.  The  light 
diffracted  by  the  second  AOD  Is  Imaged  onto  a  2-D  CCD  which  accumulates  the 
light  from  all  the  lines  of  the  Input  pattern  (perform  the  summation  over  n  in 
£q.  (4)).  The  significance  of  the  architecture  In  Figure  2  Is  primarily 
theoretical  because  It  demonstrates  that  any  linear  operation  with  separable 
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kernel  can  be  Implemented  with  the  time-space  Integrating  method.  In  practice. 
If  a  specific  separable  kernel  Is  given  a  simpler  and  more  elegant  architecture 
can  generally  be  found.  Specific  architectures  for  the  computation  of  the  2-D 
Fourier  transform,  the  moments  of  an  Image  and  synthetic  aperture  image  formation 
have  been  designed  and  they  are  discussed  In  the  applications  section  of  this 
report. 

The  second  class  of  2-D  linear  operations  that  are  implementable  with  the 
tlme-and-space  Integrating  method  are  those  with  shift  Invariant  kernels.  In 
this  case. 


A  A  ^  A  A 

g(x,y)  *  E  I  f(x,nAy)  h  (x+x,  nAy+y)  dx 
n  1 

' 

*  I  £  J f(x,nAy)  h  (x+x,y)  dxj  *  6(y+nAy) 


Where  *  denotes  convolution  and  6  is  the  Dirac  delta  function.  The  integral 
inside  the  brackets  is  the  1-D  correlation  of  the  nth  line  of  f(x,y)  with  all 
the  lines  of  the  impulse  response  function  h(x,y). 

These  1-D  correlations  must  be  shifted  along  the  direction  orthogonal  to 
the  direction  in  which  the  correlation  Is  performed  by  a  distance  equal  to  nAy. 
The  2-D  correlation  can  then  be  obtained  by  summation  over  all  the  partial 
correlations.  In  a  TSI  architecture  this  last  summation  is  performed  by  the 
time  integrating  detector  array.  The  multichannel  1-D  correlation  can  be 
performed  by  multiplying  the  1-D  Fourier  transform  of  each  line  of  the  input 


function  with  the  transforms  of  all  the  lines  of  the  filter  function  h. 

Finally  to  complete  the  architecture  a  shifting  mechanism  must  be  incorporated 
that  will  transfer  the  data  in  the  y  direction  on  the  detector  before  the 
summation  over  n  is  performed.  A  very  convenient  way  to  accomplish  this  is 
through  the  use  of  a  CCD  camera  with  which  the  transfer  can  be  performed 
electronically  [15].  Our  work  thus  far  on  TSI  architectures  for  shift  invariant 


operations  has  been  concentrated  on  the  frequency  plane/CCD  Implementation. 

Detailed  descriptions  and  experimental  results  are  presented  In  chapter  V  of 

this  report.  Eq.  (5)  however  suggests  a  general  methodology  through  which 

alternate  architectures  can  be  designed.  For  Instance,  the  1-D  multichannel 

correlation  can  be  Implemented  by  multiplication  In  the  Image  plane  and  use 

of  the  travelling  wave  nature  of  the  Input  AOD.  Similarly,  the  shifting  In 
* 

the  y  dimension  can  be  performed  by  an  auxiliary  optical  scanner  Instead  of 
the  electronic  scanning  that  Is  performed  by  the  CCD. 


III.  DEVICES 


We  mentioned  earlier  that  one  of  the  advantages  of  the  TSI  architectures 

Is  their  Implementation  with  well  developed  devices.  The  key  components  common 

to  almost  all  architectures  are  the  pulsed  light  source,  acousto-optic  devices, 

and  CCD  detector  arrays.  A  thorough  assessment  of  the  state-of-the-art  and 

experimental  characterization  of  selected  devices  was  carried  out  during  this 

reporting  period.  The  devices  we  used  in  our  experiments  are  operated  In 

unconventional  modes  and  therefore  they  had  to  be  specifically  designed  for 

our  application  or  characterized  In  the  mode  In  which  we  operate  them.  The 

limitations  that  the  devices  Impose  on  the  performance  of  the  systems  were 

identified  and  optimum  operating  modes  were  selected. 

1.  Pulsed  light  source.  A  pulsed  light  source  Is  required  in  the 

majority  of  the  TSI  architectures.  The  pulse  width  requirement  is  that  it  is 

shorter  than  the  bandwidth  of  the  Input  signal  applied  to  the  AOD.  Since  AODs 

3 

have  bandwidths  from  20  to  10  MHz,  pulse  durations  In  the  range  1-50  nseconds 

are  required.  The  pulse  repetition  frequency  must  be  locked  to  the  rate  at 

which  new  lines  of  data  are  entered  into  the  system.  This  rate  cannot  exceed 

the  Inverse  of  the  temporal  window  of  the  AOD  (  1-100  ysec)  and  typically  the 
4  5 

PRF  Is  10  -10  Hz.  The  peak  power  must  be  sufficiently  high  to  give  an  average 
-5  -3 

power  of  10  -10  W.  In  the  majority  of  the  applications  the  duty  cycle  of 

-3  3 

the  pulsed  laser  Is  10  and  therefore  peak  powers  of  10-10  mW  are  required. 
Finally,  coherence  lengths  of  .5  to  2  cm  are  needed  in  some  of  the  architectures. 
Gas  lasers  operated  In  the  cavity  dumped  mode  can  easily  satisfy  all  the  stated 
requirements.  Gas  lasers  however  are  very  inefficient  (.1%  typically),  large 
and  expensive  (particularly  with  a  cavity  dumper).  Laser  diodes  on  the  other 
hand,  have  diametrically  opposite  characteristics:  10%  power  efficiency. 
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small  size  and  cost.  Pulses  In  the  nanosecond  range  with  peak  powers  of  10-10 
mW  W  can  be  readily  produced  by  commerlcally  available  laser  diodes.  In  addition 
laser  diodes  can  be  directly  modulated  which  provides  an  added  convenience  In 
the  design  of  the  optical  architecture.  Laser  diodes  however,  have  some 
disadvantages.  The  lasing  wavelength  of  the  most  common  GaAs/AlGaAs  lasers 
Is  around  800  nm.  Both  CCD  detectors  and  acousto-optic  devices  work  better  at 
shorter  wavelengths.  The  coherence  and  temperature  stability  of  these  lasers 
when  operated  In  the  pulsed  mode  were  not  known  previously.  The  coherence  and 
stability  of  several  commerlcally  available  lasers  was  measured.  The  results 
were  published  In  a  paper  attached  as  an  appendix  to  this  chapter.  Our 
conclusions  have  been  very  positive.  Laser  diodes  that  are  designed  to  lase 
In  a  single  mode  under  cw  operation,  become  coherent  (single  mode)  within  1-2 
nanoseconds  after  the  onset  of  the  pulse.  This  sets  the  lower  limit  on  the 
available  pulse  width  to  approximately  10  nseconds.  The  maximum  length  of  the 
light  pulses  Is  limited  to  100  nanoseconds  for  coherence  lengths  In  the  order 
of  1cm,  because  the  temperature  of  the  laser  junction  increases  expodentially 
after  the  onset  of  each  pulse  causing  a  corresponding  shift  In  the  lasing  wave¬ 
length.  The  available  range  In  pulse  width  (10-100  nanoseconds)  for  coherent 
operation  Is  actually  very  convenient  for  our  experiments  because  It  allows 
processing  of  signals  with  bandwldths  up  to  50  MHz.  At  the  beginning  of  this 
reporting  period  we  felt  that  pulsed  laser  diodes  would  be  Inadequate  as  the 
source  for  most  of  the  TSI  architectures.  Happily,  our  experience  with  laser 
diodes  has  shown  the  opposite  to  be  true.  We  believe  that  the  suitability 
of  laser  diodes  Is  a  crucial  factor  that  can  make  TSI  architectures  practical 
In  the  Immediate  future,  because  of  the  low  power  requirements,  size  and 
cost  of  these  devices. 
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2.  Acousto-optic  device.  The  AOD  serves  as  the  real  time  Input 
transducer  that  brings  the  data  to  be  processed  Into  the  TSI  architectures. 

The  primary  motivation  for  Investigating  these  architectures  Is  the  excellent 
light  modulation  properties  of  AOD's  (bandwidth,  linearity,  optical  quality, 
efficiency).  A  device  was  designed  and  manufactured  specifically  for  the  TSI 
architectures.  The  custom  design  was  dictated  by  several  considerations.  The 
bandwidth  of  the  signals  we  are  processing  In  most  of  the  applications  Is  limited 
to  5-20  MHz.  For  Instance  the  standard  video  signal  from  a  TV  camera  has  a 
bandwidth  In  this  range.  Consequently,  In  order  to  obtain  a  linear  space 
bandwidth  product  In  the  order  of  10^,  a  long  acoustic  delay  Is  required. 

For  Instance,  a  standard  video  line  Is  63  yseconds  long.  The  maximum  useable 
delay  that  an  AOD  can  have  Is  determined  by  the  length  of  quality  crystal  that 
can  be  grown,  the  acoustic  velocity  and  the  acoustic  attenuation.  The  best 
available  material  Is  Te02  because  of  Its  slow  (shear  wave)  acoustic  velocity 
and  availability  of  long  crystals.  The  acoustic  attenuation  Is  relatively 
high  in  TeO.,i  but  It  permits  up  to  100  ysec  devices  for  relatively  low  band- 
widths.  The  device  we  are  working  with  has  70  ysec  delay  and  30  MHz  ldB  band¬ 
width,  at  X  ■  820  nm.  A  second  consideration  that  was  crucial  In  designing 
this  device  was  the  quality  of  the  Schlleren  Image,  particularly  since  In  all 
the  TSI  architectures  the  light  diffracted  by  the  AOD  Is  expanded  in  the 
direction  orthogonal  to  the  acoustic  wave.  The  Schlleren  image  can  be  severely 
distorted  due  to  acoustic  diffraction  which  places  nulls  In  the  diffracted  image. 
A  diamond  transducer  design  advanced  by  Dr.  Peter  Kellman  [16]  was  chosen  that 
smoothes  out  the  acoustic  diffraction  pattern.  The  specifications  and  the 
results  of  the  characterization  of  the  AOD  are  presented  In  appendix  I I I b  of 
this  chapter.  Our  conclusion  from  the  Investigation  of  AOD's  Is  that,  as 


expected .they  do  not  Impose  any  major  limitations  on  the  performance  of  the 
TSI  erchltectures.  The  accuracy,  bandwidth  and  processing  power  of  these 
processors  are  limited  by  other  components  In  the  system,  primarily  the 
detector.  This  Is  In  contrast  to  conventional  2-D  optical  processors  where 
the  real  time  2-D  spatial  light  modulator  Is  the  major  source  of  performance 
degradation. 

3.  CCD  detector  arrays.  2-D  CCD  arrays  are  used  In  the  TSI  architectures 
as  the  optical  detector.  In  addition,  the  unique  capability  of  CCDs  to  transfer 
photogenerated  charge  along  one  of  the  dimensions  of  the  array  proves  to  be 
very  useful  In  the  synthesis  of  the  most  powerful  TSI  architectures.  Therefore 
Investigation  of  the  CCD's  had  a  two-fold  purpose;  determination  of  the 
limitations  Imposed  by  the  CCD  on  overal  system  performance  and  Identification 
of  the  optimum  CCD  structures  for  the  shl ft-and-add  (or  TDI)  mode  of  operation. 

Our  Investigation  and  experiments  were  based  excluslcely  on  commerlcally 
available  CCD's.  Very  substantial  improvements  in  performance  can  be  realized 
with  devices  specifically  designed  for  this  application,  but  the  cost  of  a 
custom  CCD  array  proved  prohibitive. 

Imaging  CCD's  have  been  studied  and  characterized  extensively  previously  [17, 
18].  In  what  follows  we  will  stress  the  parameters  of  the  CCD  that  directly  affect 
the  performance  of  the  TSI  architectures  and  report  the  results  from  our 
experiments  with  these  devices.  At  present  the  CCD  Imposes  the  major  limitation 
In  the  accuracy,  bandwidth  and  processing  power  (space-bandwidth  product)  of 
TSI  architectures.  The  accuracy  Is  essentially  determined  by  the  linear 
dynamic  range  of  the  CCD.  The  dynamic  range  Is  determined  by  the  following 
equation. 


where  Is  the  number  of  photogenerated  electrons  that  will  cause  a  pixel  of 
the  CCD  to  saturate,  Nd  Is  the  average  number  of  thermally  generated  (dark) 
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electrons  that  accumulate  In  one  pixel  during  each  Integration  period  and  N 

n 

Is  the  number  of  noise  electrons  (standard  deviation).  Ns  Is  limited  by 
geometric  factors  and  the  potentials  at  which  the  CCD  Is  operated.  It  Is 
crucial  to  keep  N$  well  below  full  saturation,  to  avoid  non-linearities  but 
more  Importantly  to  avoid  blooming  (charge  spilling  over  to  adjacent  pixels) 
which  degrades  resolution.  We  have  experimented  with  CCDs  manufactured  by 
RCA  and  Fairchild  and  In  both  Instances  we  have  found  that  we  can  comfortably 
work  with  N$  *  105  electrons.  N$  could  be  conceivably  Increased,  by  perhaps 
an  order  of  magnitude,  by  Incorporating  anti-blooming  mechanisms  In  the 
device  and  Increasing  the  size  of  the  potential  well.  The  dark  current,  Nd, 

Is  of  course  a  strong  function  of  temperature.  We  have  found  that  at  room 
temperature  Nd  *  N$/2  for  an  Integration  period  equal  to  one  second.  Nd  decreases 
linearly  with  decreasing  Integration  time  until  the  plateau  of  the  dark  current 
from  the  read-out  electronics  Is  reached.  The  dark  current  can  be  eliminated 
almost  entirely  by  cooling  the  device.  Several  sources  contribute  to  the  total 
number  of  noise  electrons;  shot  noise  due  to  the  signal  and  the  dark  current, 
read-out  (thermal)  noise,  clock  feedthrough, off-chip  amplifier  noise,  fixed 
pattern  noise  (the  variation  of  dark  current,  from  pixel  to  pixel).  We  measure 
Nn  to  be  equal  to  150  electrons  for  1  second  Integration  time.  In  this  case 
the  dynamic  range  of  the  RCA  device  Is  measured  to  have  400:1  dynamic  range. 

At  shorter  Integration  times  the  dynamic  range  Is  expected  to  Increase  because 
of  the  dark  current  decreases  linearly  with  the  read-out-rate,  whereas  the  noise  , 
Increases  proportionally  to  the  square  root  of  the  read  out  rate.  At  present, 
however,  our  noise  floor  Is  limited  by  clock  feedthrough  (the  clock  waveforms 
that  are  applied  to  the  CCD  to  cause  the  charge  transfer  are  picked  up  on  the 
video  line)  and  at  shorter  Integration  times  the  dynamic  range  does  not  Improve. 

An  Improved  design  of  the  high  frequency  electronics  that  Isolates  the  clock 
circuits  from  the  video  lines  Is  expected  to  Improve  the  dynamic  range  to  more 
than  1 0:1  at  room  temperatures.  Furthermore,  cooling  the  device  will  further 


-15- 


reduce  the  noise  In  addition  to  the  dark  current.  Finally,  the  fixed  pattern 
noise  Is  eliminated  along  one  of  the  dimensions  of  the  CCD  when  It  Is  operated 
In  the  shlft-and-add  mode.  We  expect  that  we  will  be  able  to  observe  a  dynamic 
range  well  over  10  :1  (compared  to  the  present  400:1)  and  Is  feasible  to  obtain 

4 

10:1  with  present  CCD  technology.  For  large  2-D  CCD  arrays,  a  substantial 
Improvement  beyond  that  will  come  only  with  advances  In  the  state-of-the  art 
of  CCD  technology.  With  the  present  dynamic  range  of  the  CCD,  the  effects  of 
ADD  nonl Inearl ties  and  spatial  non-uniformities  are  not  detectable.  In  most 
Instances  and  the  system  accuracy  Is  essentially  limited  by  the  CCD. 

The  speed  at  which  charges  can  be  transferred  on  the  CCD  and  also  read-out 
sets  the  limit  on  the  through  put  of  the  optical  processor.  We  should  stress 
here  the  distinction  between  bandwidth  and  throughput.  The  bandwidth  Is  limited 
by  the  AOD  and  It  can  be  as  high  as  several  hundred  MHz.  If  the  results  of  the 
optical  computations  cannot  be  read-out  at  this  rate  then  we  must  either  reduce 
the  Input  bandwidth  or  cease  entering  data  periodically  to  allow  the  CCD  to  catch  up. 
In  this  case  the  throughput  Is  smaller  than  the  bandwidth.  This  situation  typically 
arises  In  radar  processing  (see  chapter  V)  where  signals  with  very  large  band- 
widths  can  be  processed,  but  since  the  pulse  repetition  frequency  of  radars  Is 
typically  several  KHz,  the  CCD  Is  read  out  very  slowly.  In  general  however,  the 
CCD  Imposes  a  speed  limitation  well  below  what  state-of-the-art  AOD's  can  provide. 

The  CCD  bandwidth  Is  fundamentally  limited  by  the  time  It  takes  for  a  charge 
packet  to  be  transferred  from  one  pixel  to  the  next.  This  depends  on  factors 
such  as  the  mobility  of  charge  carriers,  the  voltage  levels  at  which  the  CCD 
Is  operated  and  the  center-to-center  separation  between  pixels.  In  practice, 
when  we  work  with  commerlcally  available  CCD's,  the  speed  can  be  limited  by  the 
bandwidth  of  the  on-chip  amplifier  and  the  off-chip  driving  and  read-out  electronics. 
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Particularly  for  large  2-0  arrays  It  becomes  quite  an  engineering  challenge  to 
build  fast  driver  circuits  that  can  switch  faster  than  100  nsec  (IOMH2).  We  have 
driven  CCD’s  in  the  shlft-and-add  mode  with  our  circuits,  at  rates  up  to  10MHz. 

This  rate  Is  sufficient  for  the  majority  of  our  experiments  (e.g.  512x512  Images 
can  be  processed  at  30  frames  per  second).  For  high  speed  applications  It  will 
not  be  possible  to  Increase  the  10MHz  rate  substantially  without  a  custom  CCD. 

The  speed  limitations  arise  because  of  the  bottleneck  formed  by  the  read-out 
register,  as  shown  In  Figure  3a.  All  the  columns  of  the  device  feed  Into  a 
single  horizontal  CCD.  If  the  horizontal  register  Is  clocked  every  100  nsec,  then 
the  vertical  registers  cannot  be  clocked  faster  than  every  NxlOO  nsec,  where  N 
Is  the  number  of  columns  In  the  CCD.  CCD's  however  can  be  fabricated  with  multiple 
read-out  stages  as  shown  In  Figure  3b.  For  Instance  a  device  with  10  parallel 
read-out  channels  can  be  read-out  at  300  frames  per  second  with  present  CCD 
technology.  Furthermore,  GaAs  CCD  technology  allows  bandwldths  of  108-109  Hz. 

This  technology  Is  still  at  the  research  and  development  stage,  but  It  now  appears 
that  we  are  near  the  threshold  of  having  system  grade  and  probably  commerlcally 
available  devices.  In  conclusion,  the  CCD  Imposes  at  present  the  limitations  in 
speed  on  the  TSI  architectures.  The  limitation  however  Is  not  fundamental  and 

we  can  safely  expect  to  overcome  It  as  CCD  technology  advances  In  the  coming  years. 

8  9  ?  3 

TSI  architectures  operating  at  10  -10  Hz  rates  (10-10  frames/second  for  image 
processing)  are  feasible. 

5 

The  size  of  commerlcally  available  CCD  cameras  Is  typically  around  10  pixels, 
arranged  In  various  formats.  We  have  worked  primarily  with  the  RCA  device  which 
has  512  pixels  In  the  shifting  dimension  and  320  pixels  In  the  other  dimension. 
Larger  CCD's  have  been  fabricated.  For  Instance  an  800x800  device  has  been  built 
by  Texas  Instruments  for  use  In  the  Space  Telescope  and  the  Gallelo  mission,  for 
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FI6URE  3. 


CCD  ARRAY  WITH  A  SINGLE 
READ-OUT  REGISTER 

CCD  ARRAY  WITH  MULTIPLE 
(PARALLEL)  READ-OUT  PORTS. 
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NASA.  The  same  company  plans  to  produce  a  commerlcal  device  with  over  10  xlO 

pixels  In  the  next  few  years.  The  space-bandwidth  product  of  AOD's  and  the  optical 

3  3 

system  Is  typically  10  xlO  .  Therefore  current  devices  places  the  limit  on  the 
resolution  of  the  overall  system,  but  It  Is  expected  that  this  will  be  overcome 
In  the  near  future  as  larger  arrays  become  available. 

Host  commerlcally  available  CCDs  are  constructed  in  one  of  two  architectures: 
frame  transfer  or  line  transfer.  In  the  frame  transfer  devices,  the  CCD  potential 
wells  are  themselves  photosensitive.  For  Instance,  In  a  three  stage  CCD,  the 
first  stage  of  each  pixel  Is  held  at  a  high  potential  during  exposure  and  the 
photo gene rated  charge  accumulates  there.  In  the  Imaging  mode,  the  entire  charge, 
stored  In  the  array  Is  clocked  out  after  each  exposure.  In  the  TDI  mode  the 
charge  Is  transferred  by  only  three  stages,  (one  pixel)  after  each  exposure. 
Therefore  a  relatively  minor  adjustment  in  the  timing  circuits  is  required  to 
convert  frame  transfer  devices  to  TDI  operation.  The  RCA  device  with  which  we  did 
the  majority  of  our  experiments  Is  a  frame  transfer  device  and  a  variety  of 
experimental  results  with  this  device  are  reported  In  Chapter  V.  The  structure 
of  line  transfer  devices,  shown  In  Figure  4,  Is  considerably  more  complex. 

Light  Is  detected  by  an  array  of  photodiodes  and  the  photogenerated  charge  is 
transferred  to  an  adjacent  CCD  through  a  single  gate.  Such  devices  can  be 
operated  In  the  TDI  mode  In  one  of  two  ways.  The  gate  can  be  held  open  continu¬ 
ously  allowing  the  photogenerated  charge  to  flow  from  each  photodetector  to  the 
corresponding  pixel  of  the  CCD  during  exposure.  Alternatively,  the  gate  can 
opened  periodically  only  after  each  exposure.  We  have  experimented  with  both 
methods,  with  the  second  giving  slightly  better  results  In  terms  of  dynamic 
range.  Line  transfer  devices,  In  addition  to  being  more  complicated  to  operate 
In  the  TDI  mode  pose  another,  more  fundamental  problem.  As  the  charge  accumulates 
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Figure  4. 


Figure  5.  Experimental  correlator  used  to  test  the  line  transfer  CC 
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In  each  pixel  of  the  CCD,  we  are  trying  to  transfer  new  photogenerated  charge 
from  the  detectors  Into  the  partially  filled  CCD  well.  The  efficiency  of  charge 
transfer  therefore  decreases  and  the  result  Is  a  reduction  In  dynamic  range 
and  resolution.  The  reasons  we  experimented  with  line  transfer  devices  Is 
because  they  are  more  readily  available  and  In  various  array  sizes  (primarily 
through  Fairchild).  For  Instance,  all  the  available  1-D  CCDs  are  line  transfer 
devices.  Figure  5  Is  a  schematic  diagram  of  a  simple  experiment  we  performed  with  the 
1-D  Fairchild  CCD  operating  In  the  TDI  mode.  An  Input  pattern  consisting  of  two 
horizontal  slits  was  detected  with  a  TV  camera  and  the  video  signal  from  the  camera 
was  heterodyned  to  50  MHz  (the  center  frequency  of  the  Acousto-optic  device)  and 
applied  to  the  AOD.  The  Sync  signal  from  the  TV  was  used  to  trigger  the  pulsed 
laser  diode  to  produce  a  light  pulae  every  time  a  video  line  was  present  In  the 
AOD.  The  light  diffracted  by  the  AOD  Illuminated  a  mask  consisting  of  two  slits 
also  and  the  mask  was  Imaged  onto  the  CCD  array.  The  CCD  was  operated  In  the 
shlft-and-add  mode  In  synchronism  with  the  video  signal  from  the  TV  camera.  The 
output  signal  from  the  CCD  Is  the  correlation  of  the  double  slits  In  the  input 
pattern  and  the  mask  placed  In  the  optical  system.  The  signal  In  Figure  6a  was 
obtained  by  blocking  one  of  the  slits  in  the  Input  pattern  and  obtaining  the 
correlation  between  the  single  remaining  slit  and  the  double  slit  of  the  mask. 

This  is  In  effect  an  image  of  the  mask.  Similarly  in  Figure  6b  an  Image  of  the 
Input  pattern  Is  shown  by  blocking  one  of  the  slits  In  the  mask.  In  Figure  6c 
the  signal  obtained  with  all  slits  open  is  shown  and  the  correlation  between  the 
signals  In  Figures  6a  and  6b  is  obtained.  Some  of  the  experiments  reported  In 
Chapter  V  also  use  this  type  of  CCD. 

Me  conclude  this  chapter  by  noting  that  the  performance  of  the  TSI  architec- 
ures  Is  limited  primarily  by  the  CCD  detector.  The  majority  of  these  limitations 
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( speed,  space  bandwidth  product)  are  not  fundamental  to  the  technology  of  CCD's, 
but  rather  a  consequence  of  the  fact  that  existing  commerlcal  devices  are  Intended 
for  TV  camera  applications  and  they  can  be  overcome  by  a  custom  designed  device 
using  current  technology.  The  dynamic  range  of  the  present  devices  (10  :1)  is 
adequate  for  some  applications  (e.g.  pattern  recognition)  but  a  dynamic  range  of 
10*:1  is  required  for  others  (e.g.  SAR).  It  Is  also  the  one  characteristic  of 
CCDs  that  will  require  advances  In  the  state  of  the  art  of  the  technology  to  provide 
an  Improvement  of  more  than  one  order  of  magnitude  (>10  :1).  The  dynamic  range 
Issue  Is  particularly  Important  In  TSI  architectures  because  a  portion  of  the 
dynamic  range  is  typically  allocated  to  a  bias  term,  so  that  bipolar  signals  can 
be  represented.  Issues  relevant  to  dynamic  range  are  addressed  In  the  next  chapter. 
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ABSTRACT 

Laser  Diodes  are  becoming  Increasingly 
attractive  for  application  to  time  Integrating 
and  systolic  optical  computing  architectures 
where  large  bandwldths  and  coherent  processing  are 
required.  This  paper  reports  the  results  of  a 
study  to  determine  the  Interferometric  perfor¬ 
mance  of  laser  diodes  when  used  In  a  pulsed  mode 
and  where  the  Interference  effects  of  many 
sequential  pulses  are  Integrated  temporally. 

The  results  Indicate  that  fringe  visibility  Is 
high  for  as  many  as  ltr  integraged  pulses  If  the 
OPD  In  the  processor  Is  less  than  5  am  and  the 
laser  pulse  width  Is  less  than  50  nsec. 


INTRODUCTION 


The  continual  rise  In  the  quality  of  per¬ 
formance  and  affordability  of  commercially 
available  Laser  Diodes  (LD)  has  made  them  viable 
for  use  In  many  types  of  optical  computers.  The 
attractive  features  of  LDs  Include:  Their  small 
size  and  relative  ruggedness,  their  high  effi¬ 
ciency  and  hence  low  electrical  power  require¬ 
ments,  their  ability  to  be  modulated  directly 
with  large  bandwldths  and.  In  the  case  of 
single  longitudinal  mode  LDs,  their  large  coher¬ 
ence  lengths.  These  features  make  LDs  applicable 
to  many  time  Integrating  and  systolic  architec¬ 
tures,  some  of  which  employ  coherent  processing 
techniques  that  Impose  stringent  requirements 
on  the  light  source.  In  particular,  the  CCD/AO 
optical  computers  now  being  developed  at  Caltech 
for  Image  processing  and  radar  imaging  applica¬ 
tions  [1,2]  require  a  light  source  with  a  band¬ 
width  of  1  GHz  and  peak  output  power  of  at  least 
10  milliwatts.  The  light  source  Is  to  be  pulsed 
In  synchronism  with  a  master  clock  with  pulse 
widths  of  10-100  nanoseconds.  Furthermore 
the  time-integrating  and  Interferometric  detec¬ 
tion  employed  In  the  CCD/A-0  processors  Impose 
the  need  for  a  high  degree  of  uniformity  from 
■» - 
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pulse  to  pulse  In  th*  coherence  properties  of  the 
light  source.  The  coherence  requirement  Is  based  on 
the  fact  that  the  Interferometric  detection  scheme 
used  In  the  CCD/A-0  optical  computers  will  have 
OPDs  of  as  much  as  2  ml 1 1 Imete^s .  The  prime 
candidates  for  the  light  source  of  these  processors 
are  single  longitudinal  mode  LDs  which  have  cw 
coherence  lengths  of  many  centimeters  and  also 
have  the  required  output  power  and  bandwidth. 

While  the  cw  coherence  length  of  single  mode  LDs  Is 
known  to  be  adequate,  the  pulsed  coherence  proper¬ 
ties  of  these  devices  Is  not  thoroughly  understood. 
At  Issue  Is  the  ‘coherence  time”  of  the  LD,  l.e. 
the  time  after  the  onset  of  laser  oscillation  In 
which  the  LD  changes  from  Its  Initial  multi-mode 
oscillation  to  single  mode.  Also  of  Interest  Is 
the  stability  of  the  mode  In  which  the  laser  Is 
emitting  over  the  duration  of  the  pulse.  Lastly, 
since  the  light  from  many  LD  pulses  Is  to  be 
temporally  Integrated,  the  pulse-to-pulse  coher¬ 
ence  properties  of  the  device  must  be  understood. 

An  Interferometric  experiment  was  devised 
to  characterize  the  pulsed  coherence  properties  of 
single  longitudinal  mode  LDs,  the  results  of  which 
are  reported  In  this  paper.  Two  commercially 
available  LDs  were  evaluated,  the  Hitachi  HLP-1600 
and  the  Mitsubishi  NL-3001.  In  the  evaluation  we 
concentrated  on  the  HLP-1600  because,  due  to 
Its  higher  peak  power  capability.  It  was  more 
applicable  to  the  CCD/A-0  architecture.  The  HLP- 
1600  Is  capable  of  peak  output  power  of  15  mW  while 
the  NL-3001  Is  limited  to  3  mU. 

A  description  of  the  pulsed  coherence  measure¬ 
ment  experiment  Is  contained  In  section  2  of  this 
paper.  The  experimental  results  are  presented  In 
section  3  with  the  Interferometric  performance 
tradeoffs  In  pulse  width,  amplitude  and  LD  biasing 
presented.  Section  4  of  this  report  Is  a  discus¬ 
sion  of  the  results  In  which  a  brief  analysis  Is 
glvan. 


EXPERIMENT 


The  LD  pulsed  coherence  measurement  set-up  Is 
shown  schematically  In  Figure  1.  The  heart  of  the 
experiment  Is  a  Mlchelson  Interferometer  consist¬ 
ing  of  mirrors  Ml  and  M2  and  the  beam  splitter  B1. 
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Mirror  Ml  Is  Mounted  on  a  Micrometer  stage  to 
allOM  variations  In  OPD  from  0  to  5  cm.  Mirror 
M2  Is  Mounted  on  a  piezoelectric#!  translator. 

The  translator  Is  capable  of  being  driven  at 
frequencies  of  up  to  5  KHz  with  the  amplitude 
of  translators  varying  by  *  JJ2.  Modulation  of 
the  OPD  In  this  Manner  is  7  convenient  Method 
for  Measuring  fringe  depth  at  the  output  of  the 
Interferometer.  The  Laser  drive  electronics 
consist  of  a  current  pulser  with  a  dc  biasing 
capability  and  a  rise/fall  time  of  7  nanoseconds. 
Figure  2  Is  an  oscilloscope  trace  of  a  typical 
LD  drive  pulse. 


Figure  2. 


The  output  of  the  Interferometer  Is  detected 
by  both  a  high-speed  avalanche  photodiode  (APD) 
and  an  Integrating  photodiode  linear  array  (PDA), 
learn  splitter  B2  permits  simultaneous  data  collec* 
tlon  with  the  two  types  of  detectors.  Both  of  the 
detectors  employ  Integrating  lenses  to  Increase 
the  level  of  the  detected  light.  The  APD  that 
was  used  Is  capable  of  measuring  rise  times  of 
Individual  light  pulses  that  are  less  than  1  nano¬ 
second  with  a  sensitivity  of  1  mv/uW.  The  POA 
temporally  Integrates  the  light  of  many  sequential 


pulses  In  order  to  measure  the  pulse- to 
pulse  coherence  of  the  LD.  When 
data  Is  being  taken  with  the  PDA  the  two  output 
beams  of  the  Interferometer  are  made  to  be  slightly 
misaligned  along  the  dimension  of  the  PDA  by  tilt¬ 
ing  mirror  Ml.  This  causes  a  linear  fringe  pattern 
on  the  array  with  a  spatial  frequency  determined 
by  the  angle  between  the  output  beams.  The  fringe 
visibility  of  the  light  Integrated  on  the  array  Is 
thus  a  measure  of  the  uniformity  of  the  coherence 
over  many  pulses.  The  Integration  time  of  the  PDA 
Is  variable  to  allow  for  the  Integration  of  200  ♦ 
10,000  pulses.  The  Interferometric  detection  on 
the  PDA  is  analogous  to  that  In  the  CCD/A-0 
processors  In  which  the  LD  Is  used.  In  this 
application  approximately  500  light  pulses  are 
Integrated. 

The  output  from  the  detectors  Is  displayed 
on  an  oscilloscope  for  analysis.  A  1  GHz  band¬ 
width  storage  oscilloscope  Is  used  to  accomodate 
the  high  speed  of  the  APD. 

The  coherence  time  Is  estimated  by  measuring  , 
the  time  from  the  beginning  of  detectable  light 
Intensity  to  the  time  of  maximum  fringe  visibility. 
This  Is  accomplished  by  modulating  the  AP0  with 
Mirror  M2  by  t\/2  at  a  high  rate  N  1  KHz)  with 
the  piezoelectric  translator  so  that  the  response 
to  many  Individual  pulses  will  appear  simultaneous¬ 
ly  on  the  screen  of  the  oscilloscope  due  to  the 
persistence  of  the  screen's  phosphor.  Therefore 
the  trace  Is  "smeared"  because  ail  possible 
relative  phases  of  the  Interfering  beams  would  be 
detected  as  different  Intensity  amplitudes.  How¬ 
ever,  during  the  start.up  period  of  the  pulse, 
when  the  light  Is  Incoherent, the  smearing  does  not 
occur  and  thus  the  trace  of  many  pulses  appears  as 
a  single  line.  The  coherence  time  Is  approxl- 
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aately  the  difference  betMeen  the  time  light  Is 
first  detected  as  a  single  trace  and  the  tlae  of 
aaxlaua  saearlng  of  the  light  Intensity  due  to 
Interference. 

The  Intra-pulse  stability  of  the  lasing  node 
Is  aeasured  by  studying  the  trace  of  the  output  of 
the  APD  for  a  single  pulse  of  light  froa  the  In- 
terferoaeter.  The  amplitude  of  the  light  as  a 
function  of  tlae  Is  determined  by  the  relative 
phase  of  the  two  Interfering  beams.  If  the  beaas 
are  In  phase  aaxlaum  Intensity  will  be  detected; 

If  the  beaas  are  180  degrees  out  of  phase,  alnlaum 
Intensity  will  be  detected.  At  a  given  0P0  this 
relative  phase  will  change  In  a  predictable  wanner 
with  lasing  wavelength.  The  ramifications  of  the 
Intra-pulse  stability  of  the  lasing  aode  will  also 
be  measurable  on  the  output  of  the  PDA  as  a  change 
In  the  fringe  visibility  of  the  Interference 
pattern  of  the  many  integrated  pulses. 

The  Inter-pulse  stability  of  the  laser  Is 
determined  by  observing  the  time  history  (l.e. 
relative  phase  of  the  two  beams)  of  aany  light 
pulses  with  the  APD.  The  fringe  pattern  displayed 
On  the  PDA  Is  also  Influenced  profoundly  by  the 
Inter-pulse  stability  of  the  lasing  aode. 


The  primary  variables  In  this  experiment 
are  the  OPD  of  the  Interferometer,  the  pulse  width 
of  the  light  pulses,  the  peak  output  power  of  the 
laser  diode,  and  the  biasing  conditions  of  the 
U>.  All  of  these  variables  will  have  a  strong 
Influence  on  the  fringe  visibility  that  would  be 
achievable  In  an  optical  coaputer  employing  a 
pulsed  ID. 

RESULTS 

The  overall  result  of  this  study  Is  that 
pulsed  LO's  become  coherent  (l.e,  single  aode) 
very  rapidly  after  the  onset  of  laser  oscillation 
(within  about  1  nanosecond),  but  that  the  Inter¬ 
ferometer  performance  of  a  processor  employing 
laser  diodes  In  this  aode  can  be  Halted  by  three 
distinct  effects.  These  effects  occur  when  the 
OPD  Is  nonzero 

and  are  related  to  the  electrical  opera¬ 
ting  conditions  and/or  the  rise  In  temperature  of 
the  junction  area  of  the  laser  during  the  pulse. 
The  first  effect  observed  Is  the  continuous  and 
oscillatory  variation  In  the  Intensity  of  the 
Inerferlng  beams  during  a  single  pulse  due  to  a 
continuous  shift  In  the  lasing  wavelength.  This 
effect  Is  caused  by  a  shift  In  the  Index  of 
refraction  of  the  junction  area  In  the  laser  with 
temperature.  The  second  effect  that  was  observed 
Is  that,  although  each  laser  pulse  becomes  single 
aode  rapidly,  the  actual  longitudinal  aode 
selected  by  the  laser  In  which  to  oscillate,  aay 
be  different  from  pulse  to  pulse  (l.e,  the  laser 
selects  one  of  two  adjacent  Fabry-Perot  cavity 
aodes)  leading  to  a  possible  reduction  In  fringe 


depth  when  the  Integration  of  aany  such  pulses 
occurs.  The  third  effect  encountered  In  this  study 
Is  the  occasional  occurance  of  a  rapid  (much  less 
than  1  nanosecond)  aode  hop  during  the  period  of  a 
single  pulse  leading  to  a  possible  step  disconti¬ 
nuity  (depending  on  the  OPD)  In  the  aeasured 
Intensity  of  the  Interfering  beams  within  the 
period  of  a  single  pulse.  The  aagnitude  of  this 
step  Is  directly  related  to  the  OPD  of  the  system. 
The  details  of  the  measurements  of  these  three 
effects  are  presented  In  the  following  paragraphs. 

Figure  3  shows  the  leading  edge  Interfero¬ 
metric  activity  of  the  laser  diode.  The  data  In 
figure  3  are  oscilloscope  traces  of  the  output  of 
the  APD  In  which  aany  interferometer  output  pulses 
are  displayed  simultaneously.  The  OPD  for  the 
multiple  pulses  In  each  trace  are  all  different. 


Figure  3b 


leading  to  the  smeared  appearance  In  the  trace. 
This  effect  Is  caused  by  the  modulation  of  the 
position  of  Mirror  M2  by  i  X/2  and  using  the  per¬ 
sistence  of  the  oscilloscope  screen  as  described 
In  Section  II.  The  top  of  the  envelopes  In  the 
traces  of  Figures  3a  and  3  b  correspond  to  the 
Intensity  aeasured  for  maximum  constructive  Inter¬ 
ference,  while  the  bottom  of  the  envelope  corre- 
spones  to  total  destructive  Interference.  In 
Figure  3a  the  first  11  nanoseconds  of  a  50  nano¬ 
second  pulse  are  shown  for  the  case  of  zero  OPD. 
The  rippling  In  the  maximum  light  level  Is  due  to 
slight  Impedance  mismatchs  In  the  electronic  drive 
circuitry  and  also  possibly  to  relaxation 
oscillations  In  the  laser  diode.  The  time  scale 
In  Figure  3a  Is  2ns/d1v  and  thus  It  Is  obvious 
that  the  laser  Is  fully  coherent  within  about  1 
nanosecond  from  the  start  of  measurable  light 
Intensity.  The  first  8  nanoseconds  of  a  50  nano¬ 
second  pulse  for  the  case  of  OPD  ■  1  cm  Is  shown 
In  Figure  3b,  with  a  time  scale  of  1  ns/dlv. 

The  coherence  time  of  this  pulse  can  be  seen  to  be 
on  the  order  of  1.5  nanoseconds.  Both  cases  shown 
In  Figure  3  correspond  to  approximately  15  aW  peak 
output  power  with  no  dc  bias  current  used.  Pre¬ 
biasing  the  laser  to  a  dc  level  at  the  threshold 
current  of  the  laser  reduced  the  coherence  time 
slightly  from  the  case  of  no  bias  but  accurate 
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measureneits  of  the  effect  are 
difficult  because  of  the  short  (sub  nanosecond) 
tlae  scales  Involved.  The  final  Interesting 
feature  of  the  data  In  Figure  3  Is  that  the  pulse 
rise  tines  are  on  the  order  of  1  nanosecond 
despite  the  fact  that  the  current  drive  pulse  has 
a  rlsetlne  of  about  7  nanoseconds  (see  Figure  2.) 
This  effect  Is  probably  due,  at  least  In  part,  to 
the  finite  tlae  delay  before  the  start  of  laser 
oscillation  while  the  Injected  carrier  concen¬ 
tration  builds  up  In  the  depletion  region  of  the 
laser  diode. 

The  effect  on  the  Interferonetrlc  perfor- 
aence  of  a  continuous  shift  In  the  lasing  wave¬ 
length  Is  shown  In  Figure  4.  Figure  4  consists  of 
2  oscilloscope  traces  of  the  output  of  the  APD  for 
a  single  laser  pulse.  The  effect  of  the  contin¬ 
uously  shifting  wavelength  Is  a  change  In  the 
relative  phase  of  the  Interfering  beans  and  thus  a 
modulation  of  the  Intensity  that  Is  detected  within 
the  pulse.  Shown  In  Figure  4  are  two  800  nano, 
second  pulses,  one  at  0PD«2  cat  and  the  other  at 
OPD  -  4  cm.  The  number  of  cycles  present  In  the 
Intensity  modulation  during  the  pulse  Is  propor¬ 
tional  to  the  OPD  and  therefore  Figure  4a  shows 
twice  as  many  cycles  as  Figure  4b. 


Figure  4b. 


The  phase  of  the  Intensity  modulation  Is  directly 
proportional  to  the  change  in  junction  temperature 
and  thus  each  cycle  of  modulation  corresponds  to  a 
fixed  AT  In  the  junction  for  a  given  OPD.  It  Is 
further  noted  that  the  frequency  of  the  Intensity 
modulation  Is  highest  In  the  early  part  of  the 
pulse  Indicating  that  the  temperature  rise  Is  most 
rapid  at  the  beginning  of  the  pulse. 

The  effects  of  -pre-biasing  and  peak  power 
are  shown  In  Figure  5.  All  the  pulses  In  Figure 
5  have  a  pulse  width  of  2usec.  And  were  taken 
at  an  OPD  of  4  cm.  Figures  5a  and  5b  show  the 
Interferometer  output  for  laser  peak  output  power 


of  15  and  8  milliwatts  respectively,  with  no  dc 
biasing.  The  fewer  modulation  cycles  in  Figure 
5b  Indicate  less  change  In  temperature  after 
2  psec.  Figure  5c  and  Sd  show  the  effect  of 
biasing  the  laser  at  Its  threshold  current  level 
before  application  of  the  current  pulse  for  15  and 
8  milliwatts  laser  output  power  respectively.  The 
dramatic  reduction  In  the  number  of  cycles 
Indicates  that  pre-basmg  raises  the  temperature 


d 


Figure  5 
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of  the  laser  such  that  the  change  In  temperature 
during  the  application  of  the  pulse  Is  less  than 
with  no  biasing.  The  data  of  Figure  S  Is  plotted 
In  Figure  6  where  the  phase  of  the  amplitude 
modulation  Is  used  as  a  measure  of  junction 
temperature  change  with  time.  The  data  clearly 
show  an  exponential  nature  of  the  temperature 
rise  with  time  constants  that  are  on  the  order 
of  several  hundred  nanoseconds.  It  should  be 
noted  that  the  data  shown  In  Figures  4  and  5 
indicate  that  these  pulses  would  be  useless  for 
Interferometric  detection  purposes  due  to  the 
variation  from  constructive  to  destructive 
Interference  within  a  single  pulse.  For  the 
much  shorter  pulse  widths  and  OPDs  to  be  used  In 
the  CCD/A-0  processors,  only  fractions  of  a 
cycle  of  Intensity  modulation  will  occur  during 
a  pulse  rendering  It  still  useful  for  Inter¬ 
ferometric  purposes.  The  effect  of  this  phenom¬ 
enon  on  the  fringe  depth  for  the  Integration  of 
many  pulses  Is  discussed  at  the  end  of  this 
section. 

The  effect  of  sequential  laser  pulses 
oscillating  In  different  longitudinal  modes  Is 
shown  In  the  oscilloscope  traces  of  Figure  7. 

All  three  traces  In  Figure  7  are  of  the  APD  out¬ 
put  with  a  large  time  scale  to  show  a  series  of 
pulses.  In  Figures  7b  and  7c(wh1ch  have  dif¬ 
ferent  time  scales)  the  OPD  was  modulated  by  ±  X/2 
at  a  frequency  of  1  KHz  to  show  the  achievable 
degree  of  Interference.  The  rate  of  the  laser 
pulses  Is  20  KHz  and  a  short  pulse  width 
( %  50  nsec)  and  OPD  were  used  to  minimize  the 
effects  of  the  the  Inter-pulse  wavelength 
changes.  The  OPD  for  this  data  Is  approximately 
1  mm.  The  observed  effect  of  this  type  of 
multimode  behavior  Is  different  measured  Inter¬ 
ferometric  amplitudes  of  laser  pulses  that  are 
oscillating  In  different  modes.  The  amplitude 
difference  Is  a  manifestation  of  the  different 
relative  phases  of  the  Interfering  beams.  This 
phase  difference  Is  a  function  of  the  Intermode 
spacing  of  the  laser  cavity  and  the  OPD.  At 
certain  discrete  OPD's  (for  this  laser  this 
spacing  Is  Integral  multiples  of  2.42  mm)  the 
relative  phases  of  the  Interfering  beams  are  the 


same  In  the  Interferometer  for  adjacent  modes. 

The  examples  In  Figure  7  Illustrate  a  severe  case 
In  which  the  OPD  was  chosen  to  show  large  phase 
differences  In  the  Interference  of  adjacent 
longitudinal  modes.  This  Intermode  Instability 
was  found  to  be  a  strong  function  of  peak  power 
and  the  choice  of  operating  point  for  the  laser. 
At  output  power  levels  of  1/2  maximum  the  Inter¬ 
mode  stability  was  found  to  be  >95* 


a 


The  third  phenomenon  that  was  found  to  affect 
the  Interference  properties  of  the  laser  diode  Is 
a  sudden  switch  In  mode  within  the  period  of  the 
pulse.  Figure  8  Illustrates  the  effect  of  this 
on  the  detected  Intensity  of  the  Interfering 
beams.  At  the  given  OPD,  the  change  In  mode 
during  the  pulse  resulted  In  a  step  change  of 
approximately  180  degrees  In  the  phase  of  the 
Intensity  modulation.  The  frequency  of  mode 
hopping  was  found  to  be  a  strong  function  of 
pulse  width  and  electrical  operating  point  and  Is 
reduced  to  an  Insignificant  level  by  using 
shorter  pulses,  dc  biasing,  and  output  power  of 
approximately  1/2  maximum. 

Evaluation  of  the  effects  of  the  three  types 
of  mode  Instabilities  described  above  on  time 
Integration  Interferometry  was  accomplished  by 
studying  the  output  of  the  PDA.  The  effects  of 
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Intra-pulse  node  hopping  and  Inter-pulse  node 
changes  were  reduced  to  an  Insignificant  level  as 
described  above,  leaving  only  the  continuous  shift 
In  lasing  wavelength  with  temperature  as  the 
dominant  factor  affecting  the  Interferometric  per¬ 
formance.  Figure  9  Is  an  oscilloscope  trace  of 
the  FDA  output.  The  fringe  frequency  shown 
represents  a  spatial  frequency  of  about  2  llnes/m 
on  the  array.  The  trace  shown  represents  the 
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Figure  8. 

time  Integrated  Interferometric  response  of 
approximately  10,000  Individual  laser  pulses  over 
a  period  of  50  milliseconds.  The  data  shown  was 
taken  at  zero  OPD  and  thus  represents  the  largest 
attainable  fringe  depth.  The  actual  fringe  depth 
achieved  Is  not  100X  because  of  several  non- 
idealities  of  the  system.  First,  the  FDA  has 
dark  noise  which  contributed  to  the  bias..  Second 
the  very  short  multimode  portion  at  the  beginning 
of  each  pulse  will  add  Incoherently  to  result  In 
a  contribution  to  the  bias.  Lastly,  nonidealities 
In  the  measurement  set-up.  such  as  misalignment  of 
the  Integrating  lens  and  signal  spreading  on  the 
array  could  lead  to  bias  contributions. 

As  OPD  Is  Increased  the  fringe  visibility 
decreases  due  to  Increased  variations  In  the 
amplitude  of  the  Interfering  beams  with  Increasing 
temperature  during  the  pulse.  In  addition,  longer 
pulses  will  have  more  variation  Intensity  over  the 
length  of  the  pulse  which  tends  to  "wash  out"  the 
fringe  pattern.  The  effect  of  OPD  and  pulse 
width  on  fringe  visibility  Is  plotted  In  Figure 
10.  This  data  can  be  used  to  define  a  maximum 
pulse  width  than  can  be  used  for  a  given  OPD. 
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Figure  10. 

DISCUSSION 

For  a  single  longitudinal  mode  laser  diode 
the  lasing  wavelength  Is  determined  by  the  length 
and  Index  of  refraction  of  the  laser  cavity.  The 
laser  will  oscillate  In  one  of  the  Fabry-Perlot 
modesL3.4j0f  the  cavity  given  by  the  following 
condition: 


where  A  Is  the  wavelength.  L  Is  the  length  of  the 
cavity,  n  Is  the  Index  of  refraction  and  q  Is  an 
Integer.  The  change  In  wavelength  with  temperature 
Is  then  given  by 

x  "fr  ■  q ( "jt  +  Lar  >  (2) 

For  the  MLP-1600,  which  Is  double  hetero¬ 
structure  GaAIAs  device,  L  ■  300  pm.  n=  3.5,  and 
the  lasing  wavelength  Is  approximately  .83  pm. 

The  value  of  A'  for  the  HLP-1600  Is  approximately 

.06  nm/*K[5].The  change  In  Index  of  refraction 
with  temperature  Is  the  dominant  factor  In  A'. 

The  amplitude  of  the  Intensity  of  the  Inter¬ 
fering  beams  is  proportional  to  the  phase  dlf- 
erence  &$  of  the  waves: 

64  •  fMOPD)  (3) 

The  change  In  phase  difference  with  changing  A  1$ 
then  given  by 


Q  (OPD) 
A* 


Figure  9. 


Finally  we  can  use  equations  (2)  and  (4)  to 
determine  how  the  temperature  change  will  affect 
the  measured  phase  difference  In  the  Interferometer; 


d^A4)  .  2w  (OPP)  X* 

The  transient  behavior  for  the  rise  In 
junction  temperature  during  the  beginning  of  laser 
oscillation  has  been  modeled  as  follows  [6] 

8T(t)  -  AT0  (1  -  e“H 

where  AT#  Is  the  asymptotic  value  of  the  junction 

temperature  change.T  Is  the  thermal  time  constant 
which  Is  determined  by  the  thermal  resistance  and 
capacitance  of  the  junction.  The  thermal  time 
constant,  t  Is  typically  several  hundred  nano¬ 
seconds.  The  model  closely  follows  the  measured 
data  shown  In  Figure  6. 

The  overriding  conclusion  that  are 
drawn  from  the  results  of  this  study  Is  that  the 
coherence  properties  of  pulsed  laser  diodes  are 
Influenced  predominantly  by  the  transient  rise  In 
junction  temperature  during  the  time  period  of  the 
pulse.  These  thermal  effects  limit  the  useful 
pulse  width  for  coherent  processing  to  a  maximum 
of  approximately  50  nsec  for  an  OPO  of  5  mm.  The 
minimum  pulse  width  Is  limited  by  the  coherence 
time  constant  of  the  laser  diode  which  Is  found  to 
be  1-2  nsec.  Inter-pulse  and  Intra-pulse  mode 
hopping  will  also  affect  the  coherence  properties 
but  can  be  made  negllble  by  a  proper  choice  of 
electrical  operating  conditions.  An  Important 
operating  condition  that  should  be  employed  Is  a 
dc  bias  at  the  threshold  current  level  of  the 
laser  diode.  The  laser  diode  was  shown  to  have 
very  consistent  coherence  properties  for  thousands 
of  sequential  pulses  and  thus  Is  suitable  as  the 
light  source  of  the  CCD/A-0  processors. 
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IV.  DYNAMIC  RANGE  ISSUES 

In  the  previous  chapter  we  concluded  that  the  dominant  factor  limiting  the 
performance  of  TSI  architectures  Is  the  CCD  detector.  Essentially  all  2-D  optical 
processors  require  a  2-D  detector  at  the  output  and  CCD  cameras  have  proven  to  be 
the  best  device  for  this  purpose.  The  speed  and  space-bandwidth  product  of  optical 
architectures  that  use  2-D  spatial  light  modulations  are  typically  limited  by  the 
Input  device.  For  Instance,  2-D  SLMS  can  be  typically  addressed  at  30  frames/ 
seconds.  If  a  2-D  CCD  Is  constructed  with  multiple  read-out  registers,  allowing 
the  data  to  be  read-out  at  300  frames /second,  this  speed  can  not  be  realized  with 
a  conventional  architecture.  A  TSI  architecture  however  can  operate  at  this  late 
rate  because  the  AOD  that  Is  used  as  the  Input  transducer  can  be  fabricated  with 
up  to  GHz  bandwidth  (corresponding  to  over  a  thousand  frames  per  second).  There¬ 
fore,  the  speed  and  the  space-bandwidth  of  a  TSI  architecture  are  Improved  to  the 
detector  limit.  The  dynamic  range  of  a  2-D  space-integrating  optical  processor 
Is  determined  by  the  dynamic  range  of  the  detector  as  well  as  the  linearity  of 
the  Input  2-D  SLM.  The  relative  Importance  between  these  two  factors  In  determing 
the  dynamic  range  of  the  overall  processor  depends  on  the  application.  In  general. 
In  applications  where  the  signal -to-noise  ratio  at  the  Input  Is  small,  the  non¬ 
linearity  of  the  Input  device  becomes  the  dominant  factor.  The  opposite  is  true 
for  high  SNR  applications.  In  a  TSI  architecture  the  linear  dynamic  range  of  the 
AOD  Is  so  high  (10*-105),  that  the  dynamic  range  of  the  processor  Is  determined 
solely  at  the  detector  In  almost  all  cases.  The  time  Integration  that  Is  per¬ 
formed  on  the  detector  In  all  TSI  architectures,  results  In  bias  built-up  which 
reduces  the  dynamic  range  available  to  the  signal.  The  bias  built-up  arises  in 
time  Integrating  processors  because  of  the  need  to  represent  bipolar  functions 
by  photogenerated  charge,  which  Is  proportional  to  light  Intensity,  a  positive 
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quantlty.  He  denote  by  DR  and  OR'  the  dynamic  range  of  the  CCD  and  the  overall 
system,  respectively.  Then, 

"*  ■  BR  (tUsr)  • 

where  SBR  Is  the  ratio  of  the  maximum  value  of  the  output  signal  to  the  bias.  DR' 

Is  maximized  as  the  CCD  dynamic  range  DR,  and  SBR  are  made  as  large  as  possible.  In 

3 

the  previous  chapter  we  reported  that  In  our  present  experiments  DR  *  10  :1  and 
we  expect  to  be  able  to  Improve  that  by  an  order  of  magnitude  by  redesigning 
the  CCD  electronics.  The  maximum  attainable  value  of  the  SBR  Is  unity.  In  which 
case  DR'  *  DR/2.  If  the  SBR  Is  very  low  however,  DR'  «  (DR)  (SBR).  For  Instance 
If  SBR  «  10”2,  then  the  dynamic  range  of  the  system  will  be  a  dismal  10:1,  assuming 
DR  *  10^.  It  is  therefore  very  crucial  to  design  the  system  properly,  so  that  SBR  Is 
maximized.  The  first  consideration  Is  whether  to  employ  a  coherent  or  an  Incoherent 
architecture.  All  the  admissible  2-D  processing  operations  can  be  Implemented  with 
both  coherent  or  Incoherent  TSI  architectures. 

Incoherent  systems  are  Immune  to  coherent  noise  (speckle,  undesirable 
Interference  effects)  and  therefore  they  can  be  constructed  without  the  need  of 
high  quality  optical  components.  The  Information  however  In  an  Incoherent 
processor  modulates  the  light  Intensity  and  bipolar  numbers  cannot  be  directly 
represented.  A  bias  Is  added  at  the  Input  stage  of  an  Incoherent  system  to  allow 
bipolar  signal  representation  throughout  the  processor.  Let  s(x,y)  be  a  2-D 
bipolar  signal  we  wish  to  process  and  n(x.y)  be  an  additive  interference.  The 
precise  nature  of  n(x,y)  depends  on  the  application;  It  can  be  additive  noise  or 
a  deterministic  Interference  signal.  Throughout  the  following  analysis  we  will 
work  with  normalized  (unitless)  signals.  This  presents  no  problems  since  we  are 
Interested  In  the  relative  strengths  between  signals  (SBR)  and  not  their  absolute 
values.  For  convenience  we  also  take  the  maximum  value  of  the  signal  to 
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always  be  unity  and  define  the  strength  of  all  remaining  terms  relative  to  the 
signal.  He  define 


max  {s(x,y)} 
max  in(x,y)} 


The  Input  signal,  f(x,y),  to  the  Incoherent  processor  Is  given  by 

f(x.y)  *  ?  +  ^k+TT  [s(x»y>  +  •  (8) 

and  we  have  normalized  both  f{x,y)  and  s(x,y).  The  TSI  architecture  performs 

A  A* 

a  2-D  linear  operation  on  f(x,y),  with  a  bipolar  kernel  h(x,x,y,y)  (Eq.  1). 

g(x.y)  •  JJf(x.y)  [7  +  7  h(x,x,y,y)J  dxdy 

1  k  rr  ^  ^ 

*  T  +  TTk+TT  I  ls*x»y)  h(x.x,y,y)  dxdy 
k  f  f  *  * 

+  4(k4^)  I  /n(x,y)  h(x,x,y,y)dxdy.  (9) 

He  have  assumed  In  the  above  equation  that  the  functions  s,  n  and  h  have  zero 
mean  and  g  Is  also  normalized.  The  output  g,  consists  of  three  additive  terms. 

The  first  term  Is  a  constant  bias.  The  second  Is  the  desired  signal  term  which 

a 

can  attain  a  maximum  value  ^  . 

The  third  term  Is  the  Interference  filtering  through  to  the  output  plane.  In 
general,  this  term  can  vary  with  x  and  y  and  attain  a  maximum  value  y  (1/k) 
4^-j^yy  .  In  all  the  applications  we  are  considering  however,  the  Interference 
Is  suppressed  relative  to  the  signal  by  the  2-D  linear  operation.  We  denote  this 
processing  gain  by  PG.  The  Interference  term  then  acts  as  additional  bias  with 
strength  j^k+TTPG*  ^he  *n  the  *ncoherent  case  equal  to 


(10) 
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In  aost  esses  PG  »1  and  SBR  «  .  If  k  »1  (signal  much  stronger  than 

•  the  Interference)  then  SBR  *  1,  which  Is  the  maximum  value  that  can  attained.  However 
If  k  «1,  SBR  «  k  and  from  Eq.  6,DR'»DR»k.  In  many  applications  (e.g.  SAR)  this 
represents  a  disastrous  loss  In  system  dynamic  range.  Therefore  Incoherent  TSI 

•  Implementations  are  suitable  only  for  cases  where  k  »1.  In  pattern  recognition 
applications  the  Input  SNR  Is  often  sufficiently  high  to  allow  Incoherent 
Implementation.  In  most  problems  however  the  coherent  Implementation  proves 

)  preferable.  In  coherent  systems  the  amplitude  of  the  light  Is  modulated  and  that 
allows  bipolar  signals  to  be  directly  represented.  The  space  Integrating  portion 
of  the  processing  Is  performed  without  the  need  for  a  bias.  The  bias  Is  Introduced 

®  Interferometrlcally  at  the  detector  stage,  after  the  space  Integration  has  been 
performed.  The  processing  gain  that  Is  realized  In  the  space  Integrating  portion 
of  the  system  along  with  added  flexibility  In  setting  the  bias  level,  result  In 

•  a  drastically  reduced  SBR  as  we  will  show  presently.  The  Input  to  the  coherent 
processor  Is  simply 


f(x,y)  •  s(x,y)  ♦  n(x,y).  01  i 

The  output  of  the  space  Integrating  portion  of  the  processor  Is 

g'  (x,y,y)  •  J  s(x,y)  h(x,x,y,y)dx 

/  A  A 

♦  J  n(x,y)  h(x,x,y,y)dx 

t 

•  a(x,y,y)  +  b(x,y,y),  02) 

where  we  denote  by  a  and  b  the  signal  and  Interference  terms  at  the  output  of  the 

A 

space  Integrating  processor,  g'  Is  a  function  of  three  variables;  In  practice  x 
and  i  are  spatial  variables  and  y  Is  time.  A  Mas,  B.  Is  Inserted  Interferometrlcally 
at  this  stage  so  that  bipolar  signals  can  be  represented  by  photogenerated  charge 
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and  the  Integration  over  y  (time)  Is  performed  on  the  detector.  The  resulting 
signal  on  the  detector,  neglecting  normalization  constants.  Is  given  by 


/  A  A  A  A  A 

g(x,y)  *  J|  a(x,y,y)  +  b(x,y,y)  ♦  B  \c  dy 


«  2B  J  ady  +  j |a|2dy  ♦  J  |b|2dy  +  B2+2B  J  b  dy  ♦ J abdy,  (13) 

and  we  have  performed  the  Integration  In  y  over  a  unit  length.  The  first  term  in 

the  above  expansion  Is  the  desired  signal  form.  The  remaining  terms  are  all  bias 
terms.  Their  value  depends  on  both  the  signal  and  the  Interference  and  It  can 

be  precisely  determined  only  If  these  functions  are  known  (l.e.  for  each  applica¬ 
tion).  However  a  simple,  but  general  analysis  can  be  carried  out  that  Is  applicable 
In  all  the  problems  we  have  considered  thus  far.  For  Instance  It  applies  directly 
to  SAR  and  2-D  Fourier  transforms  and  with  minor  modifications  It  also  applies  to  Image 
correlation.  For  convenience,  we  normalize  the  peak  value  of  the  signal  term  to  unity: 
max  { Jady)  ■  1.  The  fourth  term  Is  a  constant  bias  term.  The  fifth  term  Is 
the  Interference  filtered  In  both  dimensions  and  therefore  It  Is  suppressed  by 
the  full  processing  gain  of  the  systems.  The  value  of  this  term  Is  taken  to 
be  equal  to  l/(k*PG).  The  last  term  can  be  neglected  when  the  Input  and  Inter¬ 
ference  are  uncorrelated  (true  In  all  the  problems  we  have  examined).  The 
second  term  is  the  Integral  J|a12dy  and  Its  value  relative  to  the  unit  defined  above 
(max  {  ady)  ■  1)  will  depend  on  the  function  f(x,y).  in  all  cases  of  Interest 
(correlation,  SAR,  spectrum  analysis)  this  term  Is  restricted  to  less  than  unity. 

The  third  term  Is  given  by 

/  |b|2dy  ■  / 1  n(x,y)  h(x,x,y,y)dx  |2dy 

'7^7  J|b'<X'y-y,l?dy  t’4) 

where  P6X  Is  the  processing  gain  resulting  from  the  Integration  along  x  alone 


(PG 


(PGX)  (PGy))  and  F*  <  1 


The  Integral  /|b'|2dy  Is  never  as  small 
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as  l/tPG^r  (i.e.  the  Incoherent  Integration  In  y  does  not  suppress  the  Interference 
as  effectively  as  coherent  Integration)  but  In  general  It  Is  considerably  less 
than  unity.  We  denote 


1 


PG' 


/  |b'(x,y,y)  |2dy. 


05) 


The  approximate  expression  for  the  SBR  of  the  coherent  processor  can  now 
be  written: 

_ 2B _ 

B2+l  +  l/(k2*PG  2-  PG'  )  +  2B/CK-PG)  (16) 

*  y 


SBR 


We  wish  to  maximize  this  ratio  by  setting  appropriately  the  level  of  the 
reference  B. 


3  (SBR) 


4 


B  =  rl  +  1/(K2*PG  2«PG'  )7 

x  y 


3B  »  -  ,  T  ,,v^  -ra¥  ’ r  u  .  (17) 

Substituting  this  value  In  Eq.16  we  find  the  value  for  the  optimum  SBR: 

1 _ 

(18) 


SBR 


opt 


'l+  l/(kZ*PG  2-PG'  )  +  1/C.K-PG) 

*  y 


Typically,  K-PG  Is  sufficiently  larger  than  unity,  and  the  second  term 

In  the  denominator  of  the  above  equation  can  be  neglected.  When  the  coherent 
2 

(PG  )  and  Incoherent  (PG'  )  processing  gains  are  sufficient  to  suppress  the 

*  y 

2  2 

Interference  below  the  signal  level  (k  PGX  PG'y>l),  then  SBRopt  «  1  and 

DR'  -  DR/2.  If  k2PG  2  PG'  «1,  then  (19) 

*  y 


SBRopt  •  k-PG„- 

By  comparison.  In  the  Incoherent  case  SBR  =  k  for  small  k.  We  see  that  if  coherent 

light  Is  used  the  slgnal-to-blas  ratio  can  be  increased  by  PG  •  /PG'  .  The 

x  y 


significance  of  this  result  cannot  be  overstated.  We  will  consider  SAR  as  an 
example  to  demonstrate  this  point.  In  SAR  the  Interference  consists  of  the  radar 
returns  from  targets  surrounding  a  point  target  that  Is  being  Imaged.  In  this 

_4 

case  k  can  be  easily  as  small  as  10  .  Therefore  we  would  have  practically  no 

2 

system  dynamic  range  with  an  Incoherent  Implementation.  PGX  Is  typically  10  . 

In  SAR  PG'  *  102.  Therefore,  /RT”“ «  10  and  SBR  .  «  (10“4  (102)  (10)  *  10"1. 
y  y  opt 

The  resultant  system  dynamic  range  Is  DR'  ■  DR  (SBR/  1+SBR)  =  DR/10.  If  the 

4 

CCD  has  a  dynamic  range  equal  to  10  :1,  then  SAR  images  can  be  formed  with  a 

3 

comfortable  10  :1  (60dB)  dynamic  range. 
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V.  APPLICATIONS 

In  Chapter  II  we  established  the  methodology  for  constructing  2-0  optical 
processors  using  the  TSI  method  and  determined  the  operations  that  are  achievable. 
Within  this  general  context  there  is  very  large  number  of  different  TSI 
architectures.  We  can  arrive  at  specific  designs  only  after  a  particular  problem 
has  been  posed.  We  have  thus  far  examined  four  applications:  image  correlation, 
synthetic  aperture  radar,  the  calculation  of  moments  and  2-D  spectrum  analysis. 

Our  work  in  these  areas  will  not  only  provide  what  we  feel  are  excellent  solutions 
to  Important  and  computationally  difficult  problems,  but  also  brings  out  the  trade¬ 
offs  and  procedures  that  are  Involved  in  designing  2-D  TSI  architectures.  This  has 
proven  to  be  an  extremely  Important  factor  in  determing  the  direction  of  the 
entire  Investigation. 

Image  correlation  Is  the  most  powerful  operation  that  can  be  implemented 
with  a  TSI  architecture.  It  is  also  the  operation  with  the  widest  applicability 
In  Image  processing.  Several  Image  correlator  architectures  have  been  designed 
and  the  first  real-time  full  2-D  correlation  with  a  TSI  architecture,  was  observed 
recently  In  our  laboratory.  The  architecture  and  our  experimental  results  are 
described  In  detail  In  the  two  published  papers  attached  as  appendices  Va  and  Vb 
at  the  end  of  this  chapter. 

Synthetic  Aperture  Radar  is  the  first  problem  to  which  optical  computers 
were  successfully  applied  and  It  appears  to  be  ideally  suited  for  TSI  implemen¬ 
tation.  The  theory  of  operation  of  this  processor  and  initial  experimental  results 
are  presented  In  appendices  Vc  and  Vd. 

2-D  Fourier  transforms  are  useful  for  the  calculation  of  image  spectra  as 
well  as  the  folded  spectrum  of  long  1-D  signals.  TSI  architectures  can  prove 
to  be  advantageous  over  the  conventional  2-D  Fourier  transforming  lens  in  certain 
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applications  despite  the  simplicity  and  elegance  of  the  conventional  approach. 

The  advantages  of  the  TSI  architecture  In  this  application  Is  the  superior  Input 
device  (AOD  vs.  2-D  SLM)  resulting  In  higher  bandwidth  and  potentially  dynamic 
range,  as  well  as  flexibility  In  selecting  the  bandwidth  and  resolution  with 
external  electronic  signals.  TSI  architectures  for  2- D  Fourier  transforms  are 
discussed  In  appendix  Ve. 

Moments  have  been  shown  to  be  useful  quantities  for  Image  recognition,  analysis 
and  normalization.  Several  TSI  architectures  for  the  calculation  of  the  moments 
of  an  Image  are  presented  In  appendix  Vf. 
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Appendix  Va 

Optical  image  correlation  using  acoustooptic  and 
charge-coupled  devices 

Demetri  Psaltis 


An  optical  proceeiing  method  it  presented  which  allow*  the  correlation  of  two  images  to  be  computed  in  real 
time  with  a  1-D  acouatooptic  spatial  light  modulator  as  the  input  device.  Two-dimensional  processing  is 
accomplished  by  a  combination  of  spatial  and  temporal  integration.  The  time-integrating  processing  is  per¬ 
formed  by  a  CCD  detector  that  is  operated  as  an  optically  addressed  correlator. 


L  Introduction 

Optical  image  processors  normally  require  at  the 
input  stage  a  real-time  2-D  spatial  light  modulator 
(SLM)1  which  creates  a  suitable  transparency  corre¬ 
sponding  to  the  input  image.  The  relatively  immature 
state  of  development  of  2-D  SLMs  is  a  major  factor  that 
has  prevented  the  realization  of  the  huge  potential  of 
optical  image  processors.  The  limitations  presently 
imposed  by  the  SLMs  can  be  overcome  either  by  further 
developments  in  device  technology  or  alternatively  by 
modifying  the  optical  system  architecture.  Severed 
architectural  designs  have  been  proposed  for  this  pur¬ 
pose.*-*  For  example,  if  the  optical  processor  can  be 
implemented  with  noncoherent  illumination  the  re¬ 
quirements  on  the  optical  quality  of  the  SLM  can  be 
relaxed,  and  a  self-luminous  display  (such  as  a  CRT) 
could  be  used  as  the  input  SLM.  In  a  recent  publica¬ 
tion  by  the  author3  a  2-D  signal  processing  technique 
has  been  presented  that  does  not  require  the  use  of 
real-time  2-D  SLMs.  This  is  accomplished  by  entering 
the  2-D  input  data  into  the  optical  processor  one  line  at 
a  time  using  a  1-D  acoustooptic  SLM.5  Each  line  is 
filtered  spatially  by  the  optical  system.  The  data  are 
processed  in  the  second  dimension  by  integrating  the 
response  due  to  consecutive  lines  on  a  time-integrating 
detector  array.  Acoustooptic  technology  is  highly  de¬ 
veloped  and  consequently  high  quality  acoustooptic 
SLMs  can  be  fabricated.  The  use  of  acoustooptic  de¬ 
vices  (AOD)  rather  than  2-D  SLMs  in  the  optical  pro¬ 
cessor  can  lead  to  improvements  in  accuracy,  speed,  and 
practicality  (size,  weight,  power  requirements,  cost).  In 
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this  paper  we  describe  the  application  of  the  time- 
and -space  integrating  processing  technique  to  the  im¬ 
plementation  of  an  image  correlator.  Image  correlation 
is  a  useful  signal  processing  operation  in  pattern  rec¬ 
ognition,  image  restoration  and  enhancement,  and  video 
compression  and  is  also  the  most  powerful  operation 
that  can  be  implemented  by  an  optical  computer. 
Therefore,  image  correlation  is  probably  the  most  sig¬ 
nificant  2-D  Bignal  processing  operation  that  can  be 
implemented  with  the  time-and -space  integrating 
method.  In  the  following  section  we  describe  the  op¬ 
eration  of  the  optical  image  correlator,  and  in  Sec.  Ill 
we  discuss  the  unique  characteristics  of  this  architec¬ 
ture. 

U.  Description  of  the  Processor 

The  time-and-Bpace  image  correlating  architecture 
is  shown  in  Fig.  1.  We  will  demonstrate  that  this  sys¬ 
tem  computes  the  cross-correlation  g(x$)  of  two  com¬ 
plex  functions  and  h(xy): 

*  JOT  +  i,y  +  9)dxdy.  (1) 

The  operation  of  the  correlator  in  Fig.  1  can  be  sum¬ 
marized  as  follows:  the  optical  system  is  a  multichannel 
1-D  correlator  which  consecutively  correlates  each  row 
of  the  function  /(x,y)  with  all  rows  of  the  function 
h(xy).  The  AOD  is  used  to  enter  the  rows  of  /(x, y) 
sequentially  into  the  optical  system.  The  1-D  corre¬ 
lations  are  summed  appropriately  by  operating  the  CCD 
detector  in  the  shift-and-add  mode.6  The  key  com¬ 
ponents  of  the  system  are  the  AOD  and  the  CCD  de¬ 
tectors. 

The  AOD  consists  of  a  piezoelectric  transducer 
bonded  onto  an  acoustooptic  crystal.  We  denote  the 
voltage  applied  to  the  piezoelectric  transducer  by  s(t ). 
The  signal  s(t)  has  the  forms  (t)  ■  ar(f)cos|u>of  +  4»(0). 
where  the  complex  envelope  a  (f )  ■  a(t )  exp\j<t>(t )]  is  the 
modulating  signal  and  wjlit  is  the  center  frequency  of 
the  AOD.  The  device  is  illuminated  by  a  collimated 
light  beam  incident  at  the  Bragg  angle  6b,  where7 


1  February  1962  /  Vol.  21,  No.  3  /  APPLED  OPTICS  491 


-50- 


•inffg 


Xui  o 
4  TO 


(2) 


X  is  the  wavelength  of  light  in  the  acoustooptic  crystal, 
and  v  is  the  speed  of  sound  in  the  crystal.  The  acoustic 
wave  that  is  induced  by  the  voltage  s(t)  causes  a  portion 
of  the  incident  light  to  be  diffracted.  In  the  Bragg  re¬ 
gime  essentially  all  the  diffracted  energy  is  concentrated 
in  the  first  order.  For  relatively  weak  modulation  levels 
the  amplitude  of  the  diffracted  light  E(x',t)  is  given 
by® 


E(x'J)  *  ci  red  a  |t  - 

x »» [>♦  ('  -  7)]  “p  b  (' — 7]]  •*»  {/ 2nr5L) 

X  expOu'o * )  e*p  |-J  *^^,*|  .  (3) 

In  Eq.  (3)  cj  is  a  constant,  x'  is  along  the  direction  of  the 
acoustic  wave  propagation,  and  A  is  the  aperture  of  the 
AOD.  Thus,  the  amplitude  of  the  diffracted  light  is 
modulated  by  the  complex  signal  a(t  —  x’/v)  over  the 
spatial  window  A,  Doppler  shifted  by  the  traveling 
acoustic  wave  by  Wo/2r,  and  deflected  around  the  Bragg 
angle  6b  For  the  rest  of  our  discussion  we  will  not  carry 
the  deflection  term  txp\-j(2*  sintfax'l/A]  in  the 
aquations  since  it  does  not  affect  the  operation  of  the 
system  we  will  describe.  In  Eq.  (3)  the  origin  of  the  x' 
coordinate  is  assumed  to  be  at  the  piezoelectric  trans¬ 
ducer,  and  x'  increases  away  from  the  transducer.  In 


our  analysis  it  is  more  convenient  to  use  the  coordinate 
transformation  x  •  -x'  +  A.  In  the  x -coordinate  sys¬ 
tem  the  origin  is  at  the  far  end  of  the  acoustooptic 
crystal,  and  x  increases  toward  the  transducer. 
Equation  (3)  can  be  rewritten  as  follows: 

£(*,»)  •  cirtct  +  «xpOW)  (4) 

We  shall  use  Eq.  (4)  in  the  rest  of  our  discussion. 

The  CCD  image  sensor  consists  of  a  matrix  of  pho¬ 
tosensitive  sites  where  incident  photons  are  converted 
to  electronic  carriers  which  are  trapped  locally  in  the 
depletion  region  of  a  MOS  junction.9  The  photogen¬ 
erated  charge  packets  can  be  transferred  to  adjacent 
pixels  along  one  of  the  dimensions  of  the  array  by 
applying  a  clock  waveform  to  the  device.  When  the 
device  is  used  as  an  image  sensor,  each  charge  packet  is 
shifted  continuously  along  the  array  after  a  single  ex¬ 
posure  to  light  until  it  reaches  the  edge  of  the  device 
where  an  output  CCD  stage  transfers  the  signal  to  the 
output  pin.  In  our  system  the  CCD  array  is  exposed 
periodically.  After  each  exposure  the  charge  that  is  ac¬ 
cumulated  in  each  6ite  is  shifted  by  only  1  pixel.  The 
photogenerated  charge  due  to  the  most  recent  exposure 
is  simply  added  to  the  charge  that  is  already  stored  in 
each  pixel.  In  Fig.  1  the  spatial  dimension  along  the 
shifting  direction  of  the  CCD  is  denoted  by  y.  Let  the 
intensity  of  the  illuminating  light  at  the  location  y 
during  the  nth  exposure  be  denoted  by  /(n,y).  The 
charge  generated  at  the  pixel  located  aty  during  the  nth 
exposure  is  proportional  to  /(n $).  After  N  exposures 
(N  >  n),  the  charge  I(n$)  shifts  N  -  n  pixels  or  by  a 
distance  (N  -  n)Ay  in  the  y  direction.  Ay  is  the  pixel 
separation.  The  charge  that  is  accumulated  in  the  CCD 
as  a  function  of  pixel  position  $  after  N  exposures  is 
given  by 

QW  -  £  l[nS  +  (n  -  AT>A>'].  (5) 

for  S  m  0  to  y  »  M  Ay ,  where  Af  is  the  number  of  pixels 
in  the  CCD  and  I(n$)  =  0  for  all y  <  0.  The  maximum 
number  of  exposures  N  for  which  the  addition  in  Eq.  (3) 
can  be  performed  is  equal  to  M.  Bromley,  and  Mona¬ 
han  et  al .6  have  used  a  CCD  detector  array  in  this  mode 
of  operation  to  perform  a  variety  of  1-D  linear  opera¬ 
tions.  In  our  system  we  use  the  CCD  detector  to  con¬ 
struct  an  array  of  parallel  1-D  correlators. 

In  most  image  recognition  applications  the  input 
scene  and  the  filter  functions  are  real.  For  this  reason 
and  to  present  the  principles  of  operation  of  the  system 
more  clearly,  we  will  restrict  our  analysis  initially  to  real 
functions  /  and  h.  For  completeness  we  will  describe 
the  operation  of  the  system  with  complex  signals  /  and 
h  at  the  end  of  this  section.  The  1-D  FourieT  transform 
of  a  transparency  with  amplitude  transmittance  h(xy) 
is  formed  with  an  astigmatic  lens  system  which  trans¬ 
forms  in  the  x  direction  and  images  along  y.10  A  holo¬ 
gram  of  the  resulting  light  amplitude  distribution  is 
formed  by  recording  its  interference  with  a  plane  wave 
reference  on  photographic  film  or  any  other  suitable 
device.  The  amplitude  transmittance  of  the  developed 
hologram  is  proportional  to10 
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|  B  *xpi-)2x  tin 8nFf,)  4  W(/,0')|* 
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4  BH’U.y)  »xp(-j2r  koBhF/m) 

4  BH(/*.y)  exp(4  j2w  xintnF/t),  (6) 

where 

H</«.y)  •  //»(*, y)  czp (~j2wf,x  4m  . 

Oh  is  the  angle  of  incidence  on  the  hologram  of  the  ref¬ 
erence  beam,  B  is  its  amplitude,  F  is  the  focal  length  of 
the  lens  in  the  x  direction,  and  fx  is  the  spatial  frequency 
variable  which  is  linearly  related  to  the  spatial  variable 
i  in  the  plane  of  the  hologram  (/,  *  £/(XF)).  In  Eq.  (6) 
only  the  term  containing  H*  contributes  to  the  corre¬ 
lation,  and  the  remaining  terms  are  blocked  out  in  the 
optical  system.  Thus  the  effective  complex  transmit¬ 
tance  of  the  hologram  can  be  written 

<h(/«0’)  *  BM*U.y)  txp(-)2x  sin BuFf,).  (7) 

This  hologram  is  placed  in  plane  P2  of  Fig.  1. 

The  image  f(xy)  is  scanned  in  a  raster  format  to 
produce  a  temporal  electronic  signal  r(t).  The  raster 
signal  r(t)  is  related  to  the  2-D  function  f(xy)  by  the 
following  equation: 

r(t) «  flit  -  (n  -  l)7']u„nAy|  (8) 

for  n  «  1  to  N,  where  v,  is  the  scanning  velocity  of  the 
device  (such  as  a  TV  camera)  that  produces  the  raster 
signal,  T  is  the  duration  of  each  raster  line  [v,T  is  the 
size  of  f(xy)  in  the  x  direction],  and  Ay  is  the  resolution 
of  f(xy)  in  they  direction  [NAy  is  the  size  of  f(xy)  in 
the  y  direction].  In  Eq.  (8)  we  assume  that /(x o')  *  0 
for  x  >  v,T  and  x  <  0.  r(t)  is  heterodyned  to  the  center 
frequency  wo  and  applied  to  the  AOD  in  plane  P\  of  Fig. 
1 .  The  modulation  t  a  (x  ,t )  introduced  by  the  AOD  on 
the  amplitude  of  the  diffracted  light  can  be  found  by 
substituting  a(t)  by  r(t)  in  Eq.  (4): 

£4(1.1)  -  r«ct  I*  r  (<  +  “  _  ~j  exp (jwot) 

m  et ^cir\ f  [(t + 1  -  r  - nT + r)  ‘•H 

X  expOW)  (9) 

We  set  A  •  v,T,  i.e.,  the  aperture  of  the  AOD  can  ac¬ 
commodate  exactly  one  raster  line  of  f(x  y).  For  con¬ 
venience  we  also  set  v ,  «  v.  At  time  instances  t  *=  nT 
the  modulation  of  the  AOD  is  given  by 

tAU^T)  ■  ei  net  f  |(n7,  +  “  - “  -  nT 4  rj  c,nAyj 

X  *xp(jwonT) 

eJ{xj\Ay)ttp(jw^\T).  (10) 

The  rect  function  can  be  dropped  in  Eq.  (10)  since  f(xy) 
was  defined  to  be  nonzero  for  0  <  x  <  vT.  Thus  at 
times  t  m  nT,  a  single  line  of  the  function  f(x, y)  mod¬ 
ulates  spatially  the  light  diffracted  by  the  AOD.  A 
pulsed  light  source  is  used  in  the  system  to  illuminate 
the  AOD  only  at  the  instances  t  “  nT.  The  temporal 
modulation  of  the  source  can  be  written  as 


£«(£) "  net 


m 


for  n  “  1  to  N,  where  r  is  the  duration  of  each  light 
pulse,  and  the  pulse  shape  has  been  approximated  by 
a  rectangular  function.  The  light  diffracted  by  the 
AOD  is  modulated  by  the  product  of  Eq.  (9)  and  (11). 
We  denote  this  modulation  function  by  (sa  (x  ,t  )■  For 
1/r  larger  than  the  bandwidth  of  r(t),  tsA  can  be  ap¬ 
proximated  by 

-  tsU)tA(xXi 

■  eipOW )  net  — — j  f  ||t  4  -  -  u,n  Ay| 

a  f(xjiAy)  expUwat)  net  |*  -"-l  •  (12) 

Lens  Li  in  Fig.  1  is  used  to  collimate  this  light  distri¬ 
bution  in  the  vertical  direction  so  it  illuminates  the 
hologram  in  plane  P2  uniformly  in  the  y  direction.  Lens 
L2  takes  the  Fourier  transform  in  the  x  direction.  The 
amplitude  of  the  light  entering  plane  P2  is  modulated 
by 


«  JtsA{x4)  exp(-;2x/,x)  dx 


<  F(J,siAy)  expl/W)  rect 


where 


Fi/.jiAy)  -  Sfixji Ay)  exp(-;2x/,x)  dx. 


The  light  immediately  after  plane  P 2  is  modulated  by 
the  product  of  Eqs.  (7)  and  (13).  The  astigmatic  lens 
system  L3  images  plane  P2  onto  the  output  plane  P3  in 
the  y  direction,  while  it  performs  the  Fourier  transform 
in  the  horizontal  (x)  direction.  The  amplitude  of  the 
light  at  plane  P3  is  given  by 

to(xj4,n)  “  /t 44 (/« 4 )«H (/* ^ )  txp(-j2vf,t 'df, ) 

■  Ci  expOW)  rect(t  -  nT)  SF(f,jiAy)H*{Jxy) 

X  expl-;'2x(»inflHF4  £')f,dfx) 


m  ci  expO'i^oO  rect 


hr) 


X  //(x,r»Ay)Mx  4  ty)dx ,  (14) 

where  £  m  £ '  +  sin OhF  and  y  are  the  horizontal  and 
vertical  spatial  coordinates,  respectively,  in  P3,  and  c2 
is  a  constant.  The  convolution  theorem  was  used  to 
obtain  the  last  form  of  Eq.  (14).  The  output  light  dis¬ 
tribution  is  detected  interferometrically  by  the  CCD 
detector  array  at  the  output  plane  to  obtain  a  detected 
signal  proportional  to  Eq.  (14).  A  reference  beam  de¬ 
rived  from  the  same  source  is  heterodyned  to  the  center 
frequency  u>0  of  the  AOD  and  made  incident  on  the 
detector  at  an  angle  Op.  The  amplitude  of  the  reference 
beam  is  described  by 


>  A  exp(/2x  tin#o4/X)  expOW)  rect 


The  signal  l(£y,n)  that  is  detected  by  the  CCD  is  pro¬ 
portional  to  the  time  integrated  intensity  of  the  sum  of 
Eqs.  (14)  and  (15) 
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where /o  “  ain0/>/A.  The  third  term  in  this  equation  it 
the  1-D  correlation  of  the  nth  row  of  f(xj)  with  all  the 
rows  of  h(xy).  The  correlation  forms  on  the  spatial 
carrier  /o.  Since  both  /  and  h  are  real  functions  only  the 
amplitude  of  the  fringe  pattern  is  modulated.  In  the 
y  direction  the  CCD  is  operated  in  the  shift-and-add 
mode  described  earlier.  The  charge  that  is  accumulated 
in  the  CCD  after  N  light  pulses  can  be  found  by  sub¬ 
stituting  Eq.  (16)  into  Eq.  (5): 

QliJ)  -  £  HijtJ  +  (n  -  M)&y) 

■  -I 

-C4|m*+  £  \Sf(xA&y)h\x  +  +  (n-AOAyldxl* 

+  2A  /f(xy»AyV «U  +  +  nAy  -  A/AyWtij  a»(2rfox )J.  (17) 

The  third  term  in  Eq.  (17)  forms  on  a  spatial  carrier  of 
frequency  fo.  By  setting  /o  equal  to  or  larger  than  the 
bandwidth  of  f(xy),  this  term  can  be  separated  from  the 
other  two  baseband  terms  by  electronic  filtering  after 
the  signal  from  the  CCD  is  converted  to  a  video  signal. 
The  envelope  of  the  carrier  in  Eq.  (17)  is  recognized  to 
be  the  2-D  correlation  described  by  Eq.  (1)  with  the 
integration  over  the  continuous  variable  y  replaced  by 
the  summation  over  the  discrete  variable  nAy.  The 
correlation  pattern  is  shifted  by  the  constant  NAy  in 
the  y  direction.  For  a  CCD  detector  with  N  horizontal 
rows,  this  means  that  each  slice  of  the  correlation  pat¬ 
tern  is  formed  sequentially  at  the  last  row  of  the  device. 
The  fast  horizontal  CCD  shift  register  transfers  each 
line  of  the  2-D  correlation  to  the  output  Btage  of  the 
device  where  it  can  be  displayed  or  processed  further 
electronically. 

We  shall  close  this  section  by  discussing  how  the 
system  of  Fig.  1  can  be  used  to  correlate  complex  2-D 
functions.  We  assume  that  we  have  the  complex 
function  h(xy)  recorded  either  holographically  or  in  a 
digital  memory.  The  1-D  Fourier  transform  of  this 
complex  function  can  then  be  produced  and  placed  in 
plane  P2  of  Fig.  1  either  optically  or  by  computer  gen¬ 
eration.  The  function  f(x  y)  is  represented  by  two  real 
functions  that  correspond  to  its  real  and  imaginary 
parts.  The  two  corresponding  electronic  raster  signals 
are  used  to  modulate  in  quadrature  the  carrier  that  is 
applied  to  the  AOD.  From  Eq.  (4)  we  conclude  that  the 
modulation  introduced  by  the  AOD  is  proportional  to 
the  complex  signal  that  is  used  to  modulate  in  quadra¬ 
ture  the  carrier.  The  optical  system  performs  the 
complex  correlation  in  the  x  direction.  The  phase  of 
the  1-D  complex  correlation  is  preserved  in  the  phase 
of  the  fringe  pattern  in  Eq.  (16).  Thus  the  full  2-D 


complex  correlation  is  formed  by  performing  the  addi¬ 
tion  over  n  in  Eq.  (17). 

M.  Discussion 

We  devote  this  section  to  the  discussion  of  the  char¬ 
acteristics  of  the  AOD/CCD  image  correlator.  The 
majority  of  the  potential  advantages  of  this  system  are 
consequences  of  the  use  of  an  AOD  as  the  real-time 
SLM.  AODs  have  been  investigated  and  manufactured 
for  many  years.  Consequently  reliable  and  relatively 
inexpensive  high  quality  devices  are  now  commercially 
avail  >ble.  The  simple  structure  of  an  AOD  relative  to 
most  2-D  SLMs  allows  compact  systems  to  be  built  with 
relatively  low  power  requirements  and  without  the  need 
for  high  voltages.  Thus  the  U6e  of  AODs  can  lead  to 
practically  feasible  optical  image  processors  in  the  im¬ 
mediate  future.  The  excellent  modulation  character¬ 
istics  of  AODs11  (high  linear  dynamic  range,  spatial 
uniformity,  and  low  scatter  level)  allow  the  input  image 
to  be  represented  in  the  optical  computer  with  high  fi¬ 
delity,  with  a  corresponding  improvement  in  overall 
accuracy.  AODs  can  accept  data  at  rates  up  to  several 
gigahertz.  We  do  not  anticipate  however,  that  this 
capability  can  be  approached  by  the  AOD/CCD  image 
processor  in  the  near  future  because  of  limitations  in  the 
speed  with  which  the  CCD  can  be  read  out.  The  system 
also  requires  a  device  which  produces  an  electronic 
raster  signal  corresponding  to  the  input  image.  In  most 
applications  this  device  can  be  a  TV  camera.  The 
current  limitations  of  CCD  and  image  sensor  tech¬ 
nologies  impose  a  limit  of  :*50-MHz  input  rate  which 
corresponds  to  the  processing  of  200  images,  each  con¬ 
sisting  of  5002  pixels  in  1  sec.  The  need  for  an  auxiliary 
image  sensor  may  be  construed  as  a  disadvantage  of  this 
technique.  Ideally  it  is  preferable  to  have  a  device 
which  serves  simultaneously  as  the  image  sensor  and  the 
SLM  for  the  optical  computer.  In  many  applications, 
however,  2-D  SLMs  are  not  suitable  for  direct  detection 
of  the  live  scene,  and  an  auxiliary  sensor  must  be  used. 
The  output  of  the  auxiliary  sensor  is  then  scanned  onto 
the  2-D  SLM  either  electronically  or  optically.  In  such 
cases,  the  ability  of  the  AOD/CCD  system  to  accept 
directly  the  electronic  raster  signals  is  an  advantage. 

The  limitations  on  the  performance  of  the  AOD/CCD 
processor  are  imposed  primarily  by  the  CCD  detector. 
These  limitations  are  not  significantly  different  from 
the  limitations  imposed  by  the  detector  on  any  optical 
image  processor.  For  continuous  processing  of  frames 
the  input  data  rate  cannot  exceed  the  readout  rate  in  the 
AOD/CCD  processor.  The  speed  at  which  commer¬ 
cially  available  CCD  detector  arrays  are  normally  read 
out  is  5-10  MHz  (standard  video  frame  rates). 
Therefore,  the  processing  Bpeed  is  limited  by  the  de¬ 
tector  if  one  is  restricted  to  using  commercially  available 
devices.  CCD  detectors  which  are  fabricated  specifi¬ 
cally  for  optical  signal  processing  applications  can  be 
made  with  several  parallel  output  stages,12  which  in¬ 
creases  the  readout  speed.  For  example,  a  device  with 
10  parallel  readout  stages  could  be  read  out  at  50- 
100-MHz  rates.  In  addition,  current  research  in  GaAs13 
CCDs  shows  promise  of  extending  the  inherent  speed 
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of  these  devices  to  hundreds  of  megacycles  per  second. 
CCD  detectors  have  —500  x  500  pixels,14  and  devices 
with  over  one  thousand  pixels  in  each  dimension  are 
presently  under  development.  The  number  of  pixels 
of  the  CCD  in  the  nonshifting  dimension  determines  in 
this  dimension  the  space-bandwidth  product  of  the 
images  that  can  be  processed.  The  number  of  pixels  in 
the  shifting  direction  determines  the  space-bandwidth 
product  of  the  Alter  in  the  shifting  dimension  but  does 
not  limit  the  size  of  the  input  scene.  In  other  words, 
this  processor  is  a  sliding  window  correlator  in  one  di¬ 
mension.  This  feature  can  be  useful  in  applications 
where  the  input  imnge  is  sensed  by  a  linear  detector 
array,  and  the  imaging  in  the  second  dimension  is  ac¬ 
complished  by  the  relative  motion  between  the  detector 
and  the  object.  The  dynamic  range,  noise,  linearity, 
and  spatial  nonuniformity  of  the  CCD  detector  are 
factors  that  affect  the  accuracy  with  which  the  pro¬ 
cessed  image  can  be  detected.  Commercial  CCD 
cameras  have  dynamic  range  in  excess  of  1000:1  with 
excellent  linearity  in  this  range.14  This  range  can  be 
extended  by  designing  CCDs  with  large  detector  ele¬ 
ments  that  can  store  a  larger  photogenerated  charge  and 
also  by  cooling  the  device  and  using  postdetection 
electronic  processing  to  minimize  detector  noise.  The 
detector  noise  is  caused  by  shot  noise  of  the  signal  and 
leakage  current,  feed-through  of  clock  transients,  and 
thermal  noise  in  the  ampliAers.14  The  trade-off  be¬ 
tween  output  noise  and  bandwidth  is  the  major  engi¬ 
neering  challenge  in  the  design  of  the  AOD/CCD  image 
processor.  The  portion  of  the  detector  dynamic  range 
that  is  utilized  to  represent  the  output  signal  is  pro¬ 
portional  to  the  ratio  of  the  signal  to  the  bias  terms  in 
Eq.  (17): 

2A  £  Jf(jjiAy)h(x  +  tjiAy  +  $)dx 
SBR  -  - — -  (18) 

NA*+  £  \ff(x/iAy)hlx  +  iJ+  (n  —  Af)Ay]dx|* 

*•1 

For  SBR  *=  1,  half  of  the  dynamic  range  is  utilized.  The 
SBR  however  can  be  significantly  lower  depending  on 
the  functions  f  and  h .  It  is  thus  crucial  to  maximize  the 
dynamic  range  of  the  CCD. 

We  are  considering  two  types  of  pulsed  Bource  for  this 
system:  mode-locked  gas  lasers7  and  semiconductor 
lasers.7  Gas  lasers  can  satisfy  all  the  requirements  of 
the  system  (pulse  width,  peak  power,  coherence,  sta¬ 


bility),  but  semiconductor  lasers  are  attractive  because 
they  are  compact,  efficient,  and  relatively  inexpensive. 
The  modes  in  a  semiconductor  laser,  however,  are  so 
widely  spaced  because  of  the  short  cavity  length  that 
interferometric  detection  i6  feasible  only  with  a  sin¬ 
gle-mode  laser.  Single-mode  laser  diodes  can  be  fab¬ 
ricated  and  are  even  available  commercially.  However 
when  these  diodes  are  pulsed  several  modes  exhibit  gain 
during  the  transients.  For  a  well-fabricated  diode  the 
transients  decay  within  1  nsec.15  Thus,  if  a  pulse  with 
duration  of  5  nsec  is  used,  single-mode  operation  can  be 
obtained  80%  of  the  time. 

The  operation  of  the  CCD  detector  in  the  shift-and- 
add  mode  has  an  important  advantageous  consequence. 
Since  the  signal  that  eventually  reaches  the  output  stage 
of  the  detector  is  a  weighted  sum  of  the  signal  detected 
by  all  the  detector  elements  in  a  single  column  of  the 
CCD  array,  the  variations  in  the  responsivity  among  the 
individual  pixels  and  dark  current  will  average  out.14 
In  addition,  speckle  noise  which  is  uncorrelated  from 
pixel  to  pixel  will  also  average  out.  Thus  the  system 
utilizes  coherent  light  which  provides  the  flexibility  of 
easily  synthesizing  a  filter  in  the  spatial  frequency  do¬ 
main  but  is  immune  to  coherent  noise. 
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ABSTRACT 


Optical  Image  correlators  are  presented 
that  use  acousto-optic  and  charge-coupled 
devices  as  the  Input  and  output  transducers 
respectively.  Experimental  results  are  pre¬ 
sented  and  the  applicability  to  pattern  recog¬ 
nition  of  a  non- linear  pseudo-correlation  that 
can  also  be  conveniently  computed  with  these 
processors.  Is  discussed. 


INTRODUCTION 

Image  processing  Is  perhaps  the  most 
natural  application  of  optical  Information 
processing  because  the  two  dimensions  of  the 
optical  system  and  its  parallel  processing 
capability  are  very  effectively  utilized  In  this 
application.  The  potential  of  optical  Image 
processors  however,  can  only  be  realized  In 
practice  If  suitable  transducers  are  available 
to  bring  the  Images  Into  the  optical  processor 
with  sufficient  speed  and  accuracy  and  also 
transducers  (detectors)  to  read-out  the  processed 
Images.  In  recent  years  the  development  of 
Acousto-Optic  Devices  (AOD)  and  semiconductor 
detector  arrays  and  light  sources,  has  led  to  the 
development  of  high  performance  optical  processors 
[1,2].  In  this  paper  we  discuss  how  acousto¬ 
optic  devices  and  CCD  detectors  can  be  used  for 
optical  Image  correlation.  The  acousto-optic 
device  Is  used  as  the  input  transducer  In  the 
optical  processor  and  It  receives  the  Image  to  be 
processed  In  the  form  of  a  video  electronic 
signal.  The  CCD  Is  used  as  the  optical  detector 
In  the  system  and  simultaneously  as  an  array  of 
olectro-optlc  correlators.  The  advantages  that 
can  be  derived  from  the  use  of  these  relatively 
smture  technologies  In  the  Implementation  of  an 
optical  2-D  correlator  are  high  speed,  flexibil¬ 
ity,  accuracy,  small  physical  size  and  power 
efficiency. 

In  the  following  section  we  discuss  the 
general  method  for  performing  Image  correlation 
with  an  acousto-optic  processor.  In  section  III 


we  review  the  holographic  Implementation  of  such  a 
processor  and  the  experimental  results  of  this 
Implementations  are  Included  In  section  IV. 


GENERAL  CONCEPT 

The  correlation  g(E,n)  of  an  Input  Image 
f(x,y)  and  a  reference  Image  h(x,y)  Is  given  by: 

9(t.h)  *//f(x,y)  h(x+E,  y+n)dxdy.  0) 

We  are  concerned  here  with  the  Implementation 
of  this  operation  with  an  optical  system  In  which 
the  Input  Image  f(x,y)  Is  Introduced  through  an 
AOD.  AOD's  are  1-D  spatial  light  modulators  with 
a  linear  space  bandwidth  product  typically  equal 
to  103  pixels.  The  size  of  the  Images  that  we 

like  to  be  able  to  process  optically  Is  at  least 

103xl03  pixels.  Therefore,  It  Is  clear  that  an 
AOD  cannot  be  used  to  simultaneously  modulate  a 
light  beam  with  an  entire  Image.  Typically,  a 
single  line  of  the  Image  can  be  accommodated  by 
the  AOD  at  one  time.  This  fact  dictates  our 
processing  strategy:  the  Input  Image  Is  entered 
Into  the  optical  processor  and  processed  one  line 
at  a  time.  The  processed  Image  lines  are  detected 
and  accumulated  on  a  2-D  CCD  camera  [2].  The 
Image  f(x,y)  must  be  sampled  In  one  of  Its 
dimensions  (In  our  notation  the  y-dlmenslon)  so 
that  Its  lines  can  be  applied  sequentially  to 
the  AOD.  In  practice  this  Is  accomplished  by 
detecting  f(x,y)  with  a  raster  scanning  TV  camera. 
Since  the  correlation  g(C.n)  will  be  computed  from 
the  samples  of  f(x,y)  we  replace  the  Integration  > 
over  the  continuous  variable  y  In  Eq.  (1)  by  a 
summation: 

gU.n)  *  l  Tf(x,nAy)  h  (x+E.nAy  *n)  dx  .  (2) 


Ay  is  the  sampling  Interval  In  the  y  direction  and 
If  It  Is  chosen  to  be  at  the  Nyqulst  rate 
(assuming  f  Is  bandllmlted)  the  correlation  g 
computed  via  Eq.  (2)  does  not  differ  from  the 
continuous  correlation.  N  Is  the  number  of  lines 
In  f(x,yj.  We  can  write  the  shift  In  the  n 

direction  by  nAy  In  the  above  equation  as  a 
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convolution  with  a  delta  function  6(n+nAy)  and 
derive  the  following  for*  for  the  correlation 

g(C.n)  ■III  |f(x,n4y)  h  (xH.n')dxj 


iSIb 


<(n'-n-nAy)dn' 


This  for*  of  the  correlation  function 
determines  directly  the  Implementation  algorithm 
of  the  acousto-optic  Image  correlator.  The  term 
In  the  brackets  In  Eq.  (3)  Is  the  1-D  correlation 
In  the  x  direction  of  the  nth  line  of  the  Input 
Image  with  all  the  lines  of  the  reference. 
Several  optical  Implementations  of  such  a  multi¬ 
channel  1-0  correlator  are  possible.  The  term  In 
the  brackets  In  Eq.  (3)  Is  a  function  of  two 
variables  C  and  n'.  and  it  must  be  shifted  In  the 
n'  direction  by  the  distance  n Ay.  In  other  words 
the  1-0  correlations  of  the  first  line  of  the 
Input  are  shifted  by  1  pixel  In  the  r\'  direction, 
while  the  correlations  of  the  Nth  line  are 
shifted  by  N  pixels.  This  can  be  accomplished  In 
an  optical  system  In  one  of  two  ways.  An 
optical  scanner  can  be  used  after  the  multi¬ 
channel  correlator  to  deflect  the  light  by  the 
appropriate  distance  for  each  Input  line. 
Alternatively  (and  In  most  cases  preferably)  a 
CCD  camera  can  be  used  to  detect  the  1-0 
correlations  and  then  shift  the  detected  signal 
by  transferring  the  charge  on  the  CCD.  The  full 
2-0  correlation  g(C.n)  Is  formed  by  accumulating 
(summing  over  n)  the  shifted  1-0  correlation  on 
the  time  Integrating  detector  array.  The 
operations  that  must  be  performed  to  Implement 
this  algorithm  optically  are  summarized  In  the 
block  diagram  of  Figure  1. 


HOLOGRAPHIC  IMPLEMENTATION 

He  will  describe  this  Implementation  [3]  with 
the  aid  of  Figure  2.  The  Input  pattern  Is  detected 
by  the  TV  camera.  The  horizontal  sync  of  the  camera 
Is  locked  to  a  stable  oscillator  which  acts  as  the 
master  clock  for  the  entire  processor.  Each  pulse 
from  this  oscillator  triggers  the  TV  camera  to 
produce  an  electronic  signal  corresponding  to  one 
of  the  lines  In  the  Input  pattern.  The  video 
Signal  Is  heterodyned  to  the  center  frequency  of 
the  AOD  and  after  amplification  It  Is  applied  to 
the  piezoelectric  transducer  of  the  AOD.  At  the 
end  of  each  horizontal  scan  by  the  TV  camera,  the 
acoustic  wave  In  the  AOD  Is  spatially  modulated 
by  the  corresponding  line  of  the  Input  pattern. 

The  clock  from  the  master  oscillator  Is  delayed  by 
the  duration  of  one  raster  line  and  It  triggers 
the  pulsed  laser  that  Is  used  as  the  source  In 
this  processor.  The  duration  of  the  light  pulses 
Is  made  shorter  than  the  Inverse  of  the  bandwidth 
of  the  video  signal.  As  a  result  the  light 
diffracted  by  the  AOD  each  time  the  laser  Is  pulsed 
Is  spatially  modulated  by  one  of  the  lines  of 
the  Input  pattern.  The  diffracted  light  enters 
an  astigmatic  lens  system  which  expands  and 
collimates  the  light  In  the  vertical  direction. 

In  the  horizontal  direction  the  light  Is  Fourier 
transformed. A  1-D  Fourier  transform  hoi oq ram  of  the 
reference  Image  h(x,y)  in  our  notation  is  placed 
In  the  Fourier  plane  of  this  astigmatic  lens 
system.  The  hologram  contains  the  reference  Image 
transformed  fn  the  x  direction  only.  Since  the 
light  Illuminating  the  hologram  Is  collimated 
vertically,  the  light  diffracted  by  the  hologram 
Is  modulated  by  the  product  of  the  transform  of 
the  current  line  from  the  Input  pattern  and  all 
the  lines  of  the  reference  Image.  A  second 


Figure  1.  Block  diagram  of  the  acousto-optic  Implementation  of  the  image  correlator 


A  variety  of  specific  optical  Imolementatlons 
are  possible  using  this  algorithm  and  the  trade¬ 
offs  Involved  do  not  make  one  of  the  Implementa¬ 
tions  clearly  superior  to  the  rest  for  all 
applications.  In  this  paper  we  discuss  a  holo¬ 
graphic  Implementation  that  shares  all  the  Charac¬ 
teristics  of  the  algorithm 

depicted  In  Figure  1:  the  Input  Image  Is  entered 
In  the  optical  system  via  the  TV  camera  and  the 
acousto-optic  device;  a  multi-channel  1-0  correla¬ 
tor  processes  each  line  of  the  Input  Image  and  a 
2-0  time  Integrating  detector  Is  used  to  accumu¬ 
late  the  1-0  correlations  and  for*  the  full  2-0 
correlation. 


astigmatic  lens  system  Is  placed  after  the  holo¬ 
gram.  The  light  Is  now  Imaged  In  the  vertical 
direction  and  transformed  again  In  the  horizontal 
direction.  The  transform  of  the  product  of  the 
transforms  produces  the  correlation  (or  convolution 
If  desired)  between  one  of  the  Input  lines  and  all 
the  lines  of  the  reference  Image.  The  Imaging 
that  Is  performed  In  the  vertical  direction  causes 
these  1-D  correlations  to  appear  stacked  In  the 
vertical  direction  at  the  output  plane  of  the 
optical  system.  Returning  momentarily  to  Eq.  (3), 
the  operation  that  has  been  performed  up  to  this 
point  in  the  processor  Is  the  1-0  Integral  of 
Eq.  (3).  A  2-0  CCD  detector  Is  placed  at  the  out¬ 
put  plane  of  the  processor.  The  photogenerated 
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Figure  2.  Acousto-optic/CCD  Image  correlator. 


2-0  charge  pattern  that  Is  stored  In  the  CCD  after 
It  Is  exposed  to  the  light  fro*  each  laser  pulse. 
Is  shifted  vertically  by  one  pixel.  If  we  trace 
the  location  on  the  CCO  of  the  charge  generated 
during  the  nth  light  pulse  we  find  that  after  the 
Nth  pulse  occurs.  It  has  travelled  N-n  pixels  In 
the  vertical  direction.  To  obtain  the  2-D 
correlation  we  oust  (according  to  Eq.  (3))  shift 
the  nth  line  by  n  pixels.  Since  N  Is  fixed  (It  Is 
the  total  masber  of  lines  In  the  Input  pattern) 
the  CCD  does  perform  the  appropriate  shifting  and 
the  entire  2-D  correction  fat  as  (shifted  by  N 
pixels)  after  Integration  on  the  CCD  (the  siamw- 
tlon  over  n  In  Eq.  3)  of  the  light  incident  on  It 
from  N  light  pulses.  The  correlation  output  Is 
read-out  continuously  by  the  CCD  In  the  form  of  a 
video  signal  which  can  be  displayed  or  processed 
further  electronically. 

In  this  processor  the  1-D  correlations  that 
are  formed  at  the  output  of  the  optical  system 
modulate  the  amplitude  of  the  light.  This  optical 
wave  must  be  TnterTiroamtrlcally  detected  In  order 
to  obtain  a  detected  signal  proportional  to  the 
field  amplitude  rather  than  its  Intensity.  The 
interferometric  detection  method  [4]  and  experi¬ 
mental  demonstration  of  It  [S]  have  been  discussed 
elsewhere.  In  this  paper  we  wish  to  concentrate 


on  the  2-D  operation  that  Is  being  performed  by 
the  processor  of  Figure  2,  when  Interferometric 
detection  Is  not  used.  In  this  Instance  the 
pattern  g'(£,n)  formed  on  the  CCD  Is  given  by  the 
following  expression  [4]: 


g'(E.n)  •  I  |  /f(x,n4y)  h  (xH,  nAy«n)dx|2  (4) 
n-1  J 

The  function  g'U.n)  Is  similar  to  the  correla¬ 
tion  In  form,w1th  the  Important  exception  that  the 
1-D  correlations  In  the  x-directlon  are  squared 
before  the  summation  In  the  second  dimension  is 
performed.  This  operation  Is  clearly  non-linear 
but  It  Is  shift  Invariant.  Since  g'U.n)  can  be 
very  conveniently  calculated  with  the  acousto¬ 
optic  Image  processor,  we  Investigated  Its  proper¬ 
ties  to  determine  Its  possible  utility  for  pattern 
recognition.  Using  the  Schwarz  Inequality  It  can 
be  shown  that 

g'  U.n)  <  I  l/l  f(x,nAy)  |2  dx  |2  ■  G*  (5) 
n 

and  the  equality  holds  only  for  g'(C.Ti)  *  G'.  This 
result  is  significant  because  It  Indicates  that 
g'(C.n)  Is  maximized  when  the  Input  and  the 

reference  Images  are  matched  and 
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aligned  spatially.  Therefore  It  could  be  used  to 
recognized  patterns.  Me  dust  however  consider 
the  performance  of  a  pattern  recognition  system 
based  on  this  operation,  when  noise  Is  present. 

A  full  analysis  of  this  case  Is  beyond  the  scope 
of  this  paper,  but  we  will  point  out  several 
laiportant  facts.  First,  the  slgnal-to-nolse 
ratio  analysis  that  Is  typically  performed  to 
determine  the  performance  of  pattern  recognition 
algorithms  that  are  based  on  correlation  Is  not 
appropriate  In  the  nonlinear  case.  The  non¬ 
linearity  In  g'  results  In  noise  components  at 
the  output  that  are  not  normally  distributed  and 
therefore  the  underlying  distribution  becomes 
Important  In  the  determination  of  the  probabil¬ 
ities  of  detection  and  mlsclasslflcatlon.  Further¬ 
more,  patterns  that  belong  to  different  classes 
but  correlate  well  (and  therefore  are  likely  to 
be  mlsclasslfled  by  a  linear  correlation 
algorithm)  can  be  well  separated  by  the  non¬ 
linear  correlation,  and  vice-versa.  For 
Instance,  If 

6  -  I  j\  f(K.nAy)  |2  d*  ,  (6) 

Is  the  value  of  the  autocorrelation  peak  of 
the  Image  f,  we  denote  by  «G  the  peak  value  of 
the  crosscorrelatlon  between  f  and  a  second 
Image  h(x,y)  not  belonging  to  the  same  class  as 
f.  a  Is  a  constant  satisfying  -1<a<1.  The  non¬ 
linear  crosscorrelatlon  of  the  same  two  functions 
Is  denoted  by  BG',  where  G'  Is  defined  In  Eq.  (5) 
and  0  Is  a  constant  satisfying  0<B<1.  It  can  be 
shown  [6]  that  given  a,  6  Is  In  the  range 
2  2 

s  <B<1  or  a  <B<a  If  the  Images  Involved  are  real 
and  positive.  Clearly  B  can  be  smaller  than  a, 
which  Intuitively  Indicates  that  If  this  Is  the 
case  two  patterns  can  be  separated  more  effec¬ 
tively  with  the  non-linear  correlation  g'.  More 
formally,  we  calculate  the  probability  of  false 
alarm  (the  probability  of  classifying  h(x,yj  as 
belonging  to  the  class  represented  by  f(x,y))  as 
a  function  of  the  parameter  B  for  the  non-linear 
correlation  case.  This  function  Is  plotted  In 
Figure  3  for  an  Input  SNR-1,  assuming  a  linear 
processing  gain  of  104,  a  value  of  a  ■  .7  and  for 
a  fixed  probability  of  detection  Pp  ■  .96.  On 

the  same  diagram  the  probability  of  false  alarm 
that  we  obtain  under  the  same  conditions  using 
linear  correlator  Is  Indicated.  Me  note  that  In 


Figure  3  there  Is  a  very  low  probability  of  false 
alarms  for  both  cases  (this  Is  a  somewhat  super¬ 
fluous  case  since  a  Is  relatively  low  and  the  SNR 
Is  high)  but  we  can  also  see  that  the  probability 
of  false  alarm  can  be  smaller  for  the  non-linear 
correlator.  Of  course  It  can  also  be  higher 
depending  on  the  value  of  B .  6  Is  determined  by  the 
Images  f  and  h  and  therefore  we  conclude  from  this 
exercise  that  a  recognition  algorithm  based  on  non¬ 
linear  correlation  can  out-perform  the  linear 
correlator  for  a  certain  class  of  Images.  In 
general,  the  non-linear  correlation  can  provide 
adequate  performance  for  a  large  class  of  pattern 
recognition  applications.  A  complete  statistical 
characterization  of  the  non-linear  correlation  will 
be  presented  In  a  future  publication. 

EXPERIMENTAL  PROCESSOR 

A  photograph  of  the  experimental  acousto- 
optic/CCD  Image  correlator  Is  shown  In  Figure  4. 

The  apparatus  Is  a  hardware  Implementation  of  the 
system  shown  In  Figure  3.  The  light  source  used 
In  this  experiment  Is  a  pulsed  laser  diode  with 
50  nsec  pulse  width.  The  Inverse  of  the  pulse 
width  (1/50  nsec  ■  20  MHz)  must  be  at  least  twice 
the  video  bandwidth,  therefore  video  signals  with 
up  to  10  MHz  bandwidth  can  be  processed  with  the 
system.  The  peak  power  of  this  laser  can  be  as 
high  as  gw,  resulting  In  an  average  light  power 
of  approximately  10  mW  which  Is  adequate  for 
detection  by  the  CCD.  A  custom  fabricated  acousto¬ 
optic  device  was  the  Input  electronlc-to-optlcal 
transducer.  This  device  Is  a  shear  acoustic  wave 
TeO,  Bragg  cell,  with  30  MHz  IdB  bandwidth  at 
820  nm  (the  laser  wavelength).  In  excess  of  4001/ 
watt  diffraction  efficiency  and  most  significantly, 
the  acoustic  delay  of  the  device  Is  70  usee.  The 
long  acoustic  delay  Is  required  In  this  processor 
so  that  we  can  accommodate  an  entire  standard  video 
line  (63  usee).  The  light  diffracted  by  the  A0D 
1$  demagnlfled  by  a  factor  of  approximately  4  with 
two  spherical  lenses.  In  order  to  match  the  size  of 
the  video  lines  from  the  AOD  (4  cm)  with  the  size 
of  the  transparencies  used  to  fabricate  the 
hologram  (1  cm).  The  demagnlfled  Schlleren  Image 
of  the  AOD  Is  reflected  towards  the  hologram  and 
Fourier  transformed.  The  hologram  was  formed  from 
a  transparency  recorded  on  a  high  speed  holographic 
plate  (to  avoid  the  phase  distortion  Introduced  by 
the  plastic  substrate  of  film)  with  a  HeNe  laser. 
The  components  that  are  used  for  recording  the 
hologram  are  visible  In  the  far  end  of  the  optical 
bench  In  Figure  4.  The  holograms  are  recorded  on 
dlchromated  gelatin  to  obtain  high  diffraction 
efficiency.  Me  obtain  In  excess  of  20X  efficiency 
with  the  dlchromated  gelatin  holograms  at  B20  nm. 
The  light  diffracted  by  the  hologram  Is  reflected 
towards  the  CCD,  Imaged  vertically  and  transformed 
horizontal ly.  The  CCD  -used  In  the  experiment 
ts  a  commercially  available  (Fairchild)  1-D  device 
oriented  vertically.  Special  timing  and  driving 
electronic  circuits  were  built  to  operate  the 
device  In  the  tlme-delay-and-lntegrate  (TDI)  mode 
necessary  for  this  processor.  The  1-D  array 
produces  slices  of  the  2-D  correlation  surface  In 
the  n  direction,  for  a  fixed  C  value.  The  slices 


Figure  4.  Experiment*!  Acousto-optic/CCD  Image  correlator. 


for  different  C  values  can  be  observed  by  translat¬ 
ing  the  CCD  horizontally.  A  1-D  CCD  «ms  chosen 
for  this  Initial  experiment,  rather  than  a  2-0  CCD 
which  can  produce  the  entire  2-D  correlation 
simultaneously,  because  Its  output  can  be  easily 
monitored  on  an  oscilloscope  which  has  alloMd  us 
to  easily  align  and  calibrate  the  system.  The 
Input  pattern  (shown  In  Figure  5a)  was  detected 
by  a  high  resolution  TV  camera  (not  shown  In 


(b) 

Fig.  5(a).  Input  Fatten)  (b)  Optically  Coasted 
Auto-Correlation 


Figure  4).  The  output  signal  from  the  CCD  for  5 
horizontal  positions  Is  shown  In  Figure  5b.  This 
composite  photograph  Is  the  2-D  autocorrelation 
of  the  pattern  In  Figure  5a  computed  by  the  system 
In  Figure  4.  Interferometric  detection  was  not 
used  In  these  experiments,  therefore  the  non-linear 
correlation  described  by  Eq.  4  Is  obtained.  The 
pattern  In  Figure  5a  Is  In  good  agreement  with  the 
autocorrelation  expected  from  the  simple  pattern 
In  Figure  5a.  Me  attribute  the  asytwietrles  notice¬ 
able  In  Figure  5b  to  non-linearities  and  phase 
distortion  In  the  hologram. 

ACKNOWLEDGMENTS 

The  research  reported  In  this  paper  Is  sup¬ 
ported  by  the  Army  Research  Office  and  the  Air 
Force  Office  of  Scientific  Research. 

Me  thank  Dr.  Peter  Kellman  for  his  assistance 
In  the  design  of  the  acousto-optic  device  used  In 
the  experiments  and  Mr.  Ed  Roos  from  Crystal 
Technology  for  the  fabrication  of  the  device. 

REFERENCES 

Cl]  Special  Issue  on  Acousto-optic  Signal 

Processing,  Proc.  IEEE,  Vol.  69,  1,  Jan.  1981. 

[2]  K.  Bromley,  et.  al.,  Proc.  SPIE,  Vol.  118, 
p.  118,  1977 

[3]  D.  Psaltls,  J.  Opt.  Soc.  Am.,  71,  p.  198, 

1981 

[4]  D.  Psaltls,  Appl .  Opt.,  21.  p.  491,  1982 

[5]  M.  Haney  and  D.  Psaltls,  this  volume. 

[6]  S.  Venkatesh  and  D.  Psaltls,  to  be  published. 


Appendix  Vc 


Real-time  optical  synthetic  aperture  radar  (SAR)  processor 


Demetri  Pee  his 
Kelvin  Wagner 

California  Institute  of  Technology 
Department  of  Electrical  Engineering 
Pasadena,  California  91 1 25 

Keywords:  two- dimensions!  signal  processing:  synthetic  aperture  radar:  acousto-optic 
devices,  imaging,  image  processing. 

Optical  Engineering  21  (SI  822-828  (September/ October  1982/ 


Abstract.  A  real-time  optical  synthetic  aperture  radar  (SAR)  processor  is  de¬ 
scribed.  The  processor  utilizes  an  acousto-optic  device  as  the  input  electronic- 
to-opticat  transducer  and  a  CCD  camera  that  serves  as  the  optical  detector  and 
simultaneously  performs  the  focusing  of  the  SAR  image  in  the  azimuth 
direction. 
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I.  INTRODUCTION 

Synthetic  aperture  radar  (SAR)  still  represents  the  most  successful 
application  of  optical  computing,  even  though  more  than  30  years 
have  elapsed  since  the  initial  demonstration  of  the  optical  SAR  pro¬ 
cessor.  Optical  computers  are  used  routinely  today  to  form  SAR 
images  from  radar  signals  that  are  collected  by  aircraft  or  spacecraft 
and  recorded  on  photographic  film.  The  requirements  of  modem 
radars,  however,  are  often  not  met  by  the  present  film-based  optical 
processors.  These  requirements  include  higher  image  quality  (resolu¬ 
tion,  dynamic  range,  artifacts,  etc.),  real-time  image  formation,  flexi¬ 
bility,  and  on-board  processing  capability  In  order  to  meet  such 
requirements,  digital  computers  are  increasingly  being  used  to  form 
SAR  images.  The  dramatic  advances  in  microelectronics  in  recent 
years  have  made  it  feasible  to  construct  digital  SAR  processors  that 
can  provide  better  image  quality  (due  to  the  highest  accuracy  and  the 
flexibility  in  programming  a  digital  computer)  than  film-based  SAR 
processors.  In  addition,  digital  processors  can  be  built  (as  they  have  in 
some  cases)  that  have  real-time  and  on-board  processing  capabilities. 
It  is  not  the  purpose  of  this  paper  to  present  a  comparison  of  optical 
versus  digital  techniques  in  SAR  (the  interested  reader  is  referred  to 
Ausherman's  paper1),  but  it  is  necessary  to  point  out  that  a  number  of 
problems  remain  with  digital  SAR  processors.  The  complexity  of 
these  systems  results  in  a  very  costly,  power  consuming,  relatively  large 
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and  heavy  processor.  Thus,  even  though  it  is  conceivable  to  build  a  low 
resolution  real-time  digital  processor,  for  many  of  the  applications  this 
is  an  impractical  solution. 

Very  significant  advances  have  also  been  achieved  in  the  area  of 
electro-optics  which  have  resulted  in  corresponding  improvements 
in  the  state  of  the  art  of  optical  computers.  Specifically,  acousto¬ 
optic  technology  has  matured,  and  consequently  high  quality  de¬ 
vices  are  now  available  to  be  used  as  the  input  spatial  light  modulator; 
semiconductor  detector  arrays  (CCD's  and  photodiode  arrays)  have 
proven  to  be  excellent  as  detectors  in  the  optical  computer,  and  the 
semiconductor  light  sources.  (LED’s  and  laser  diodes)  which  have 
been  developed  primarily  for  optical  communications,  are  a  very 
efficient  light  source  in  many  optical  processors.  These  and  other 
developments  have  made  it  possible  to  construct  real-time,  high 
performance,  power  efficient,  compact  and  relatively  inexpensive 
optical  computers  such  as  the  acousto-optic  spectrum  analyzer2  and 
the  ambiguity  function  radar  processors.1  In  this  paper  we  describe 
an  optical  SAR  processor  in  which  the  modern  components  avail¬ 
able  for  optical  computing  are  fully  utilized,  and.  therefore,  we 
believe  that  the  resulting  processor  has  great  potential  for  applica¬ 
tions  where  on-board,  real-time  SAR  image  formation  is  required. 

In  Sec.  2  the  fundamentals  of  SAR  are  reviewed,  in  order  to 
establish  the  notation  we  will  be  using  in  the  paper.  A  comprehensive 
treatment  of  SAR  can  be  found  in  Refs.  4  and  5.  In  Sec.  3  the 
operation  of  the  optical  processor  is  described  in  detail,  and  in  Sec.  4 
we  discuss  its  performance  characteristics.  Our  experimental  results 
to  date  are  reported  in  Sec.  5. 

t 

2.  SAR  SIGNALS 

The  side-looking  SAR  geometry  is  depicted  in  Fig.  I .  The  vehicle 
(aircraft  or  spacecraft)  is  traveling  with  a  constant  velocity  v  along 
the  tj  direction  and  at  height  h.  Coded  pulses  are  emitted  periodically 
through  an  antenna  mounted  on  the  side  of  the  vehicle.  In  this  paper 
we  assume  that  the  pulses  are  chirp  coded.  The  transmitted  wave¬ 
forms  S(t)  in  complex  notation  is  given  by 

S(t)  =  £  rect  [~~~]  exp[jb(t - nT)2]  exp(j2irv0t)  .  (I) 

I) 

where  r  is  the  pulse  duration,  l/T  is  the  pulse  repetition  frequency 
(PRF),  b  is  the  chirp  rate,  and  v0  is  the  microwave  frequency  of  the 
radar.  The  transmitted  waveform  illuminates  a  patch  of  the  surface 
to  be  imaged  (the  ground),  and  part  of  it  is  reflected  back  towards  the 
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vehicle  and  detected  by  the  antenna.  The  objective  of  SAR  it  to  form 
an  image  of  the  ground  from  these  reflections.  We  will  discuss  how 
an  image  of  a  single  point  scatterer  (impulse)  located  at  coordinates 
(=(0Mnd  jj*  ijp  on  the  ground  can  be  formed.  Since  the  SAR  image 
formation  is  a  linear  operation,  knowledge  of  the  impulse  response 
completely  describes  the  system.  The  signal  received  by  the  antenna 
due  to  a  single  point  scatterer  is 

r(t)  *  A(t)S(t— 2R/c)  .  (2) 

where  R  is  the  instantaneous  range  from  the  antenna  to  the  point 
scatterer  ••((<,.%)  A(t)  is  the  far-field  pattern  of  the  antenna.  From 
the  geometry  of  Fig.  I,  R  can  be  written  as 

R(0  *  '/(n0~l)?  +  *0J  *  */(ri0-vt)3  +  R02  ,  (3) 

where  R#  *  is  the  range  when  the  vehicle  crosses  17  =  1^. 

In  most  cases,  the  variation  of  the  range  R(t)  with  time  can  be 
neglected  within  the  duration  r  of  a  single  radar  pulse,  and  therefore 
R(t) »  R(nT).  In  addition,  the  range  R0  is  typically  much  greater 
than  the  distance  |i)  —  qj.  This  allows  us  to  txpand  the  square  root 
in  Eq.  (3)  as  follows: 

(vnT  —  t/gf 

R(t)  »  R(nT)  »  R0  + - 2R~"  •  (4) 

Using  the  above  equation  and  Eq.  (I),  we  can  rewrite  Eq.  (2)  as 

[t-2R0/c-  Ar-nT*l 

- - - J 

X  enp[jb(t  —  2R0/c—  Ar— nT)2] 


light  sourca.  AOD— acousto-optic  davica.  Ft  is  tha  focal  langth  of  tha  Ians 
L.  and  tha  brofcan  linas  kndicata  tha  path  of  tha  rays  of  tha  mtaranca 
wave.) 

ft—  2R0/c  —  nT  "] 

r(t)  =  J  A(nT)  reel  [ - 2- - J  ^ 

X  exp[jb(t-2R0/c  -  nT)2]  exp[-j(2irvo/cR0)  (vnT-tj,,)2] 

X  cxp(j2rrv0t)  .  (6) 

The  received  signal  r(t)  must  be  processed  to  produce  an  image  of  the 
point  scatterer  on  the  ground.  In  the  next  section  we  will  describe  in 
detail  how  the  real-time  optical  processor  that  is  presented  in  this 
paper  forms  the  SAR  image  from  the  signal  r(t).  In  deriving  Eq.  (6),  a 
number  of  simplifying  assumptions  and  approximations  were  made, 
which  may  or  may  not  be  justifiable  in  practice  depending  on  the 
particular  application.  We  will  proceed  with  the  description  of  the 
system  based  on  this  relatively  simple  form  of  the  SAR  equation  [Eq. 
<6)3.  and  in  Sec.  4  we  will  discuss  the  necessary  modifications  to  the 
system  for  cases  in  which  the  conditions  set  in  this  section  are  not  met. 

3.  ACOUSTO-OPTIC/CCD  SAR  PROCESSOR 

A  schematic  diagram  of  the  processor  is  shown  in  Fig.  2.  The  system 
is  illuminated  by  a  pulsed  laser.  The  light  amplitude  of  the  source  is 
modulated  by 


X  exp(j2 w0t)  exp(— j2rv0  2R0/ c)  exp(— j2rrv0Ar)  .  (5) 

The  variation  of  the  antenna  pattern  A(t)  during  a  single  pulse  ca  n  be 
neglected,  and  hence  A(t)  »  A(nT).  The  quantity  At  =  (vnT  - 
«lor/R.c  has  units  of  time  and  is  very  small  compared  to  2R0/c  if 
R0»(q—tu|.  Therefore,  Ar  can  be  neglected  in  Eq.  (5) except  in 
the  term  exp(-j2trv0Ar)  because  in  this  term  Ar  is  multiplied  by  v 
which  is  the  very  large  radio  frequency .  The  term  exp(—j4  rrv.R.  /  c) 
is  an  inconsequential  constant  phase  term  and  can  be  omitted.  With 
these  modifications,  we  can  write  the  final  form  for  r(t)  as 


P,„  -  j;,*,  [1^1]  . 


(7) 


where  r0  is  the  duration  of  each  light  pulse.  The  spherical  lens  L( 
collimates  the  light  from  the  source,  and  the  cylindrical  lens  L2 
focuses  the  light  in  the  vertical  (y)  direction  so  that  it  can  pass 
through  the  aperture  of  the  acousto-optic  device  (AOD)  placed  in 
plane  P,.  The  received  radar  signal  r(t)  is  heterodyned  to  the  center 
frequency  v,  of  the  AOD,  and  a  reference  signal  Bexp(j2irv2t)  is 
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added  to  h.  The  frequency  v2  is  chosen  such  that  the  difference  v2  — 
v,  is  equal  to  the  bandwidth  of  each  radar  pulse: 

Vj  -  v,  ■  br/w  .  (8) 

The  need  for  the  reference  signal  will  become  apparent  shortly.  The 
resulting  signal  r*(t)  is  related  to  r(t)  by  the  following  equation: 

r*(t)  «  r(t)  exp[-j2ir(v0  -  v,)t]  +  Bexp(j2trv2t)  .  (9) 

r'(t)  is  applied  to  the  piezoelectric  transducer  of  the  AOD  of  Fig.  2. 
The  light  diffracted  by  the  AOD  is  modulated  by* 

S,(t.x)  -  sect  (£)  P(t)  f  [i  +  j  •  (10) 


where  x  is  along  the  direction  of  propagation  of  the  acoustic  wave,  X  is 
the  aperture  of  the  AOD,  and  is  the  speed  of  sound  in  the  AOD.  The 
undiffracted  light  is  blocked  in  the  focal  plane  of  the  cylindrical  lens 
Lj.  The  combination  of  lenses  L3  and  Lj  accomplishes  two  tasks.  First, 
since  the  two  lenses  are  separated  by  the  sum  of  their  focal  lengths,  a 
single  plane  wave  incident  on  L3  will  be  recollimated  when  it  exits  the 
lens  Lj.  In  addition,  the  impulse  response  of  the  system  in  the  x 
direction  from  plane  P,  to  plane  P2  is  made  to  be  equal  to 

h(x,x)  =  exp[jb,(x  — x)2]  exp(-j2irv,x/va)  ,  (II) 


where  x  is  the  horizontal  coordinate  in  plane  P2.  The  constant  b|  can 
be  set  by  appropriately  choosing  the  focal  lengths  of  Lj  and  Lj  and 
the  distance  d.  The  term  exp(— j2rrv,x/vv)  reflects  the  fact  that  the 
optical  system  following  the  Bragg  cell  is  tilted  so  that  its  optical  axis 
coincides  with  a  wave  diffracted  at  the  Bragg  angle.  In  Eq.  ( 1 1)  we 
assume  that  the  effects  of  the  lens  apertures  are  negligible.  In  the 
vertical  direction  y,  the  light  is  recollimated  by  the  lens  L4,  and 
therefore  the  amplitude  of  light  entering  plane  P2  does  not  vary 
along  y.  At  P2  a  transparency  is  placed  immediately  in  front  of  the 
CCD  camera.  The  intensity  transmittance  T(x,y)  of  this  mask  is 


T,*  'I  ‘  ^  1 

T(x,y)  *=  j  +  j  cos 


where  u0  and  bj  are  constants  that  will  be  specified  later.  The 
instantaneous  intensity  incident  on  the  CCD  is  given  by 


K*.y.») 


T(x.y) 


(t.x)  h(x.x)dx 


(13) 


The  CCD  is  operated  in  the  shift-and-add  mode.7  In  this  mode  of 
operation  the  device  is  exposed  to  light  periodically.  The  photogen¬ 
erated  charge  is  accumulated  on  the  detector  for  a  short  time  inter¬ 
val,  and  after  each  exposure  the  entire  photogenerated  charge 
pattern  is  electronically  shifted  by  one  pixel  along  one  of  the  dimen¬ 
sions  of  the  CCD.  The  photogenerated  charge  due  to  the  next 
exposure  is  simply  added  to  the  charge  that  is  already  stored  in  each 
pixel,  and  then  the  process  is  repeated.  In  our  system  the  charge 
transferring  is  done  in  synchronism  with  the  PRF  of  the  radar,  and 
the  integration  period  is  set  equal  to  the  period  T  of  the  radar.  The 
charge  generated  on  the  CCD  during  the  nth  radar  pulse  is  given  by 


QOt.y.n) 


t+aT/J 


/ 

t-at/2 


l(x,y.t)dt 


2iv#rr0T(x,y)  A(nT)  sine 


t2rr(vj  — v.)x  2irv„  _  ,  1 

+  bias  terms  .  (14) 

The  derivation  of  Eq.  (14)  is  straightforward  but  tedious,  and  it  is 
presented  in  Appendix  A.  This  charge  pattern  gets  shifted  along  the 
y  direction  by  (N  —  n)  pixels  on  the  CCD,  after  K  exposures  have 
taken  place.  The  total  charge  that  accumulates  at  each  pixel  located 
at  coordinates  (x  ,y)  after  N  exposures  is 

N 

Q(*.y)  -  X  Q[*-y+(N-n)Ay.n] 


®voTTo 


sine 


it -2*) 

»rvB  \  c  / 


sine 


2Nv0v*Ta 


+  bias  terms  . 


cAyR„ 
cos  [4wu0x  +  d>3 


(15) 


In  the  above  equation  Ay  is  the  pixel  separation  in  the  CCD.  u0 = (v2 
—  v,)/v0,  and  6  is  a  constant  phase  term.  Q(x  ,y)  is  the  final  output 
of  the  processor,  and  its  form  demonstrates  the  imaging  capability  of 
the  system,  in  the  x  direction,  Q(x,y)  is  a  sine  function  with  width 
irval  brand  centered  at  x  =  2R0va/c.  In  other  words,  we  obtain  the 
image  of  the  point  scatterer  located  at  (  =  on  the  ground,  focused 
in  the  (  direction.  The  resolution  in  the  (  direction  is  equal  to  6r  = 
irc/2br.  This  is  a  well-known  result  for  range  resolution  in  radar 
systems.’  The  carrier  at  spatial  frequency  2up  arises  from  the  inclu¬ 
sion  of  the  reference  signal  in  the  acousto-optic  device  which  allowed 
us  to  record  on  the  CCD  the  phase  of  the  detected  signals.  This  is 
necessary  in  this  system  because  the  Doppler  information  that  is 
essential  for  the  focusing  in  the  azimuth  (q)  direction  is  encoded  in 
the  phase  of  the  range  compressed  signal  Q(x.y,n).  In  addition, 
since  the  output  forms  on  a  carrier,  it  can  be  easily  separated  from 
the  bias  term  in  Eq.  (15). 

In  the  y  direction.  Q(x ,  y)  is  also  a  sine  function  whose  position  is 
proportional  to  q0.  the  location  of  the  point  scatterer  on  the  ground 
in  the  azimuth  direction.  The  width  of  this  sine  function  is  equal  to 
cAyRo/Nvgt^T2,  and  it  determines  the  resolution  in  azimuth.  In 
ground  coordinates  q.  the  width  of  the  sine  function  corresponds  to 
an  azimuth  resolution 


cRq 

2Nv0vT 


X0R0/2Di  . 


D,  =  NvT  is  the  distance  that  the  vehicle  collecting  the  SAR  data 
travels  during  the  time  interval  NT,  and  it  is  equal  to  the  synthetic 
aperture  of  the  system.  Therefore,  the  azimuth  resolution  obtained 
with  this  processor  conforms  with  previously  derived  results’  for 
SAR  systems.  The  entire  pattern  in  shifted  in  the  y  dimension  by  the 
distance  NAy.  For  a  CCD  with  N  pixels  in  the  horizontal  direction, 
this  implies  that  after  the  signal  is  integrated  on  the  CCD  for  N 
pulses  to  produce  a  focused  image,  it  arrives  at  the  edge  of  the  device 
(at  y  =  N  Ay)  where  a  separate  CCD  stage  transfers  an  entire  line  of 
the  data  (a  slice  of  the  image  for  each  azimuth  position)  to  the  output 
pin  of  the  CCD  device.  The  azimuth  slices  are  continuously  pro¬ 
duced  as  long  as  the  flight  continues,  producing  in  real  time  an  image 
of  a  long  strip  on  the  ground  parallel  to  the  direction  of  the  flight. 
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4.  DISCUSSION 

In  this  section  we  discuss  some  of  the  issues  relative  to  the  perfor¬ 
mance  of  the  optica)  processor  we  have  described.  We  will  address 
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several  performance  criteria  separately  and  comment  on  the  effects 
of  the  processor  architecture  and  the  devices  used  in  the  system.  A 
complete  in-depth  analysis  of  the  performance  is  beyond  the  scope  of 
this  paper. 


In  the  previous  section  we  derived  the  formula  for  the  resolution  that 
can  be  obtained  in  the  along  track  (azimuth)  direction: 

cR0 

*■»  "  2Nv0vT  ’  (16) 

N  is  the  only  parameter  in  the  above  equation  that  is  related  to  the 
processor.  N  is  the  number  of  radar  pulses  that  are  used  to  form  the 
SAR  image  of  each  point  scatterer  on  the  ground.  In  the  AO/ CCD 
processor.  N  is  atoequal  to  the  number  of  pixels  of  the  CCD  in  the 
shifting  direction  (y).  Commercially  available  CCD  cameras  have 
approximately  500  pixels.  Several  devices  with  approximately  twice 
this  number  have  recently  been  developed*  or  are  currently  under 
development.  If  a  CCD  with  I03  pixels  is  used,  the  azimuth  resolu¬ 
tion  obtainable  with  this  processor  is  22.S  meters  on  the  ground.  This 
figure  was  obtained  by  using  the  parameters  of  the  SEAS  AT  radar4 
that  was  flown  by  N  AS  A.  The  azimuth  resolution  will,  of  cou  rse,  be 
different  for  different  radars.  To  obtain  lower  resolution,  larger 
CCD's  would  have  to  be  used .  It  is  unlikely  that  a  significant  increase 
in  the  size  of  monolithic  CCD  cameras  will  take  place  in  the  near 
future.  It  is  possible,  however,  to  construct  larger  arrays  by  inter¬ 
facing  a  number  of  separate  chips.  As  N  is  increased  and  finer 
resolution  is  achieved,  other  factors  in  the  processor  become  limit¬ 
ing.  such  as  optical  aberrations,  mechanical  /  electronic  stability,  and 
light  source  coherence  over  the  time  period  NT.  Finally,  for  low 
resolution  imaging,  some  of  the  approximations  that  were  made  in 
Sec.  2  may  not  be  valid.  For  instance,  if  the  approximation  that  the 
range  of  each  point  target  remains  constant  as  the  plane  flies  past  it  is 
not  valid,  an  effect  known  as  range  curvature4  results.  Range  curva¬ 
ture  can  be  corrected  in  our  processor  simply  by  tilting  one  of  the 
cylindrical  lenses  in  the  system  which  introduces  barrel  distortion 
that  can  exactly  cancel  out  the  range  curvature. 


The  AO/ CCD  processor  continuously  produces  slices  of  the  SAR 
images  in  the  azimuth  direction,  and  therefore  the  size  of  the  SAR 
■mage  is  not  limited  by  the  processor  in  this  direction. 

The  resolution  in  the  range  direction  (0  on  the  ground  is  given  by 


nc 

2br 


(17) 


The  bandwidth  of  the  chirped  radar  pulses  is  equal  to  br/rr,  and 
therefore  the  resolution  in  range  is  limited  by  the  temporal  band¬ 
width  of  the  processor.  The  bandwidth  of  the  AOD  used  in  the 
system  is  not  the  primarily  limiting  factor  since  devices  with  several 
gigahertz  bandwidth  arc  available.  More  importantly,  the  duration 
of  the  light  pulse  r0  must  be  shorter  than  the  inverse  of  the  band¬ 
width  of  the  signal  to  avoid  smearing  of  the  range  compressed  signal 
[Eq.  ( 14)].  For  typical  radar  band  widths,  r0  should  be  several  nano¬ 
seconds.  Several  laser  sources  are  capable  of  producing  nanosecond 
pubes  with  adequate  peak  power.  We  are  primarily  considering  laser 
diodes  because  they  are  compact  and  power  efficient.  Laser  diodes 
can  lase  in  a  single  mode  under  cw  operation  (and  therefore  be 
coherent),  but  when  they  are  pulsed,  several  modes  exhibit  gain 
during  the  transients.  The  need  for  coherence  in  the  system  imposes 
with  present  state-of-the-art  devices  a  minimum  pulse  width  of  —20 
ns.  Therefore,  if  a  laser  diode  is  used  in  the  system,  the  bandwidth  of 
the  radar  must  be  equal  to  SO  MHz,  which  corresponds  to  range 
resolution  equal  to  3  m.  This  can  be  lowered  by  an  order  of  magni¬ 


tude  if  a  pulsed  gas  laser  is  used.  The  additional  factors  mentioned  in 
our  discussion  on  azimuth  resolution  also  become  increasingly 
important  for  finer  range  resolution. 

44.  Image  size  in  range 

The  number  of  pixels  in  the  range  direction  is  limited  by  the  space- 
bandwidth  product  of  the  AOD  or  the  CCD  in  the  nonshifting 
direction,  whichever  is  smaller.  At  the  present  time,  the  CCD 
imposes  this  limit  at  approximately  IG3  pixels.  The  range  coverage 
can  be  extended  by  using  several  processors  operating  in  parallel. 

4i.  Flexibility 

A  potential  application  for  the  AO/ CCD  processor  is  on-board 
real-time  image  formation.  In  such  applications  the  radar  geometry 
can  be  expected  to  change  from  time  to  time  or  even  continuously. 
Enough  flexibility  must  be  built  into  the  system  so  that  it  can  be 
adaptable  to  the  changing  conditions.  One  method  for  achieving  this 
is  by  the  use  of  a  real-time  2-D  spatial  light  modulator*  in  place  of  the 
fixed  mask  in  Fig.  2.  The  impulse  response  of  the  processor  can  then 
be  altered  to  track  changes  in  the  radar  geometry. 

44  Dynamic  range 

The  dynamic  range  is  defined  as  the  maximum  unsaturated  bright¬ 
ness  in  the  SAR  image  divided  by  the  minimum  detectable  level 
above  the  noise.  In  general,  a  large  dynamic  range  can  be  observed  in 
a  SAR  image  because  the  noise  detected  at  radio  frequencies  is  very 
effectively  suppressed  through  the  pulse  compression  in  both  range 
and  azimuth  that  is  performed  to  bring  the  SAR  image  into  focus. 
The  potential  for  high  dynamic  range,  however,  can  only  be  realized 
if  the  processor  that  forms  the  SAR  image  can  provide  it.  In  an 
optical  processor,  essentially  every  component  of  the  system  con¬ 
tributes  to  diminish  the  dynamic  range  available  at  the  output  by 
adding  noise  or  by  introducing  nonlinearities  and  aberrations  in  the 
system.  In  the  AO/  CCD  processor,  the  CCD  detector  is  the  domi¬ 
nant  factor  that  limits  the  dynamic  range.  The  maximum  brightness 
of  the  SAR  image  is  equal  to  the  maximum  charge  that  can  be  stored 
in  each  pixel  of  the  CCD.  minus  the  charge  that  corresponds  to  the 
bias  terms  in  Eq.  (15)  and  the  dark  current  that  accumulates  during 
the  integration  time.  The  bias  is  signal  dependent  and  is  largest  at 
portions  of  the  SAR  image  that  have  maximum  average  intensity. 
Therefore,  relatively  sparse  objects  can  be  imaged  with  a  larger 
dynamic  range.  For  a  single  point  scatterer  on  the  ground,  the  bias 
can  be  only  1/2  of  the  full  dynamic  range  of  the  CCD,  but  for  a 
distributed  target  the  bias  increases  as  Vm,  where  M  is  the  average 
number  of  point  scattercrs  on  the  ground  that  are  located  at  the  same 
range  in  a  distance  NvT  along  the  azimuth  direction.  The  minimum 
detectable  level  at  the  output  of  the  processor  is  determined  by  the 
fixed  pattern  noise  of  the  CCD  (the  variation  of  the  dark  current 
from  pixel  to  pixel),  optical  scattering,  quantum  noise  primarily  due 
to  the  bias,  and  thermal  and  amplifier  noise  from  the  electronics.10 
Our  calculations"  show  that  the  dynamic  range  of  the  images  that 
will  be  produced  by  the  experimental  processor  we  arc  presently 
constructing  is  —200: 1 .  A  commercially  available  CCD  camera  is 
used  in  the  experimental  processor,  and  post-detection  signal  pro¬ 
cessing  is  applied  in  order  to  minimize  noise.  The  dynamic  range  can 
be  increased  to  over  10s:  1  by  cooling  the  CCD  to  eliminate  the  dark 
current  and  by  using  a  CCD  specifically  designed  for  this  application. 

5.  EXPERIMENT 

The  CCD  camera  is  utilized  in  this  system  not  only  as  the  optical 
detector  but  also  as  a  multichannel  correlator  by  operating  it  in  the 
shift-and-add  mode  described  earlier.  The  signal  that  comes  out  at 
each  column  (at  position  x)  of  the  device  is  the  correlation  between 
the  transmittance  of  the  mask  as  a  function  of  y  at  the  same  position 
x  and  the  ^nal  corresponding  to  the  temporal  variation  of  the 
incident  light  intensity.  We  have  performed  an  experiment  to  dem¬ 
onstrate  the  operation  of  the  CCD  as  an  optical  multichannel  corre¬ 
lator.  The  experimental  setup  is  shown  in  Fig.  3.  A  light  emitting 
diode  (LED)  is  used  as  the  light  source.  The  intensity  of  the  LED  is 
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Fig  3.  Experimental  electro-optic  ambiguity  function  processor. 
(LED— light  omitting  diode.  L,  —collimating  Iona.  M— mask,  Lj— imaging 
lana.  CCD— camera.) 
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Fig.  4.  Ambiguity  gtocaaaot  signals:  (a)  input  (LED)  wmtomi;  (b)  maafc; 
(c)  ambiguity  function. 

temporally  modulated  by  the  chirp  signal  shown  in  Fig.  4(a).  The 
chirp  signal  that  modulates  the  LED  represents  the  variation  of  the 
intensity  detected  by  the  CCD  [the  function  Q(x ,  y ,  n)  in  Eq.  ( 14)]  as 
a  function  of  pulse  number  n.  The  duration  of  this  waveform  is  equal 
to  NT,  and  its  bandwidth  is  equal  to  v0vJNT /cR0.*  The  bandwidth 
of  the  waveform  in  Fig.  4(a)  is  30  Hz,  and  its  duration  is  1  s.  The 
CCD  we  used  in  this  experiment  has  N  =  512  pixels  in  the  vertical 
dimension,  and  therefore  the  duration  of  one  second  corresponds  to 
a  radar  pulse  repetition  frequency  equal  to  l/T  *  0.5  kHz.  These 
parameters  were  chosen  to  be  approximately  equal  to  the  parame¬ 
ters  of  an  experimental  aircraft  radar  which  is  flown  periodically  by 
the  Jet  Propulsion  Laboratory.  We  intend  to  use  data  collected  by 
this  radar  to  test  the  processor  when  it  is  completed. 

The  light  from  the  LED  is  collimated  by  lens  L,  in  Fig.  3,  and  it 


illuminates  the  mask  denoted  by  M  in  Fig.  3.  A  photograph  of  this 
mask  is  shown  in  Fig.  4(b).  The  intensity  transmittance  in  the  vertical 
direction  is  a  chirp  signal  whose  chirp  rate  is  proportional  to  the 
horizontal  position.  The  signal  at  the  center  of  the  mask  matches  the 
waveform  that  is  used  to  modulate  the  LED.  The  mask  is  imaged  by 
lens  Lj  onto  the  CCD,  which  is  operated  in  the  shift-and-add  mode. 
The  output  signal  from  the  CCD  at  each  horizontal  position  is  the 
correlation  of  the  waveform  modulating  the  LED  and  the  transmit¬ 
tance  of  the  mask  at  that  horizontal  position.  The  output  waveforms 
from  the  CCD  from  selected  vertical  locations  are  shown  in  Fig.  4(c). 
This  2-D  waveform  is  known  as  the  ambiguity  function13  of  the  chirp 
signal,  and  Fig  4(c)  displays  the  familiar  tilted-ridge  structure  of  the 
ambiguity  function  for  this  particular  waveform. 
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7.  APPENDIX  A:  DERIVATION  OF  EQUATION  (14) 


t+nT/2 

Q(x,y.n)  =  f  I(x,y,t)dt  . 
t-nT/2 

Substituting  Eq.  (13)  in  Eq.  (14): 


(14) 


dt  .  (Al) 


We  will  first  evaluate  the  integral  over  x  in  the  above  expression. 
Using  Eqs.  ( 10)  and  (II): 


g(t,x)  =ys,(t.x)h(x,x)dx 

-/~  (■£•)  P(t)r’ ^t  +  — jexp[ib,(x-x)J] 

(2irv.x  \ 

“j  — - jd*  •  <A2) 

Substituting  the  expressions  for  P(t)  and  r'(t)  from  Eqs.  (7)  and  (9): 

=  x  l1^)  /""  (£) 

n 

x  {'  (‘ + "p  ["i!”<v°  ■ ,,)  (‘ +  \t)J 

H  (,+t)]| 


+  Bexp 


X  exp[jb,(x-x)J]  exp  j  dx  . 

and  the  expression  for  the  received  signal  r(t)  from  Eq  (6)  is 


(A3) 


f. 
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X  exp 


X  exp  [jb, (x  - x)1]  exp  (~j2rV|X/v0)  dx  .  (A4< 

The  later  pulse  width  r0  it  chosen  sufficiently  smaller  than  the  bandwidth  of  the  radar  pulses  (t0  <  br  /  rr)  so  that  the  temporal  variation  of  the 
signal  in  the  above  equation  can  be  neglected  over  the  duration  of  each  light  pulse.  With  this  approximation  Eq.  ( A4)  can  be  rewritten  as  follows: 

g(t.x)  *  J  "**  (  ~~~)  exp(j2^v,t) y’rect  (-£-)  A(nT)  rtet  [—  ■■^R--/-C]  exp  [jb(x/vft-2R0/c)J] 


\-)2ino 


x  eXp  cR —  (vnT-»!o)2|+  Bexp  [j2rr(v2-v,)x/va]  exp  [j2tr(v2 


~vi)nT]|  exp  [jb,(x-x 


)>]d*. 


We  can  assume  that  |X|  >  v  r4  2R0vo/c,  i.e.,  the  range  delay  is  such  that  the  reflected  radar  pulse  is  entirely  in  the  aperture  of  the  AODat  the 
instant  the  laser  is  pulsed.  This  can  be  ensured  by  appropriately  setting  the  relative  phase  of  the  radar  and  laser  pulse  repetition  frequencies.  The 
parameter  b,  (the  focusing  power  of  the  optical  system  in  the  x  direction)  is  set  equal  to  b/  vB* .  Finally,  the  offset  frequency  v,  —  v,  is  made  to  be 
equal  tom/T,  where  m  is  an  integer.  This  can  be  accomplished  by  deriving  v,  —  v2  from  the  pulse  repetition  frequency  I /T.  The  function  g(x,t) 
can  then  be  written  as  follows: 

g('x.«)  *2  rtet  (A^L)|A(nT)  exp  exp  exp  (j  f  met 


X  exp 


|^~j"7T*<*~2Rova/c)*j  dx  +  Bexp[j2rr(v2-v,)x/vJ  exp  [jn*(vJ--viy*/b]j  *  2  ™  (~T~) 


[~(i-2Rov«/c)J  exp["j7S7(vnT-^J  exp  |~j  ~y(x-2R0vft/c)  (2R0va/c)J 


X  \A(nT)  var*inc 


X  exp  (X2-4R0J  v#*/«?)j  +  Bexp[j2»r(v,-v2)x/vJ  exp  [jVfvj-v^/b]  j 


We  substitute  the  above  expression  in  Eq.  (14): 


t+nT/2  / 

,y.nT)  *  T(x,y)  J  2  rec1  ( — J~~)  A<nT)|2  v^r^sinc2  J“~“(*~ 

t-nT/j  »  °  '  \  ° 


2R0v./c)  +  IBI2  +  2B  A(nT)v 


X  sine 


[br  -  I  f2ir(v2-vl)x  2»rv0  "j) 

—  (x-2R0va/c)Jcos  - - -  +  —  (v„T -no?  -*-♦!>  dt  =  2T(i,y)BvBrr0 

*nc  ^  ^  (*-2R0v./c)J  cos  [2rr(v2  — V|)x/va  4  2*rv0(vnT  — ij^/cR,,  4  4]  4  bias  terms 
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In  the  above  equation,  the  phase  terms  from  Eq.  (A6)  that  do  not 
depend  on  the  index  n  have  been  lumped  in  the  parameter  £. 

S.  APPENDIX  B:  DERIVATION  OF  EQUATION  (15) 


Q(i.y) 


N 

2Q(*.y-nAy+NAy.nT)  . 

a 


05) 


Substitute  Eq.  ( 14)  in  the  above  equation  and  the  expression  for  the 
transmittance  of  the  mask  from  Eq.  (12): 

"  (I  I 

Q(x.y)  =  X  2Bvarr0  +  - 

o 

X  cos  [2sru0x-irbj(y-(n-N)Ay)2/x]| 

X  A(nT)  sine  (x-2R0vo/c)J 

X  cos[2ir(vJ-v|)x/vft+2irv0(vnT-ij0)2/cR0  +  ^]  .  (Bl) 


The  spatial  frequency  u0  on  the  mask  must  be  selected  so  that  the 
sum  frequency  uc+(v,—  v,)/v0  of  the  two  cosine  functions  in  the 
above  equation  is  sufficiently  large  so  that  the  signal  term  that  is 
riding  on  the  sum  frequency  can  be  separated  from  the  bias  terms  in 
the  spatial  frequency  domain.  To  accomplish  this,  we  set  uc  = 
<v2  -  vl  )/v0.  We  write  the  product  of  the  cosines  as  a  sum,  and  the 
term  of  interest  in  Eq.  (Bl)  takes  the  following  form: 

Q(x.y)  =  (BvftfT0/2)sinc  [(br/irv0)  (x-2R0v0/c)] 

N 

X  J  A(nT)  cos  f4m0x  —  irb2yJ/x 
n 


+  2jrbj(n— NlAyy/x-^Aj^tn  — N)J/x  +  2jrv0v2T2n2/cR0 

-  4irv0unTii0cR0  +  2irv0i,02/cR0  +  ^]  .  (B2) 

The  focusing  of  the  SAR  image  in  the  azimuth  direction  (q)  is 
accomplished  by  the  summation  over  n  in  the  above  equation.  The 
summation  will  result  in  a  well-focused  image  in  the  y  direction  if  the 
terms  containing  n2  in  the  argument  of  the  cosine  are  canceled.  To 
accomplish  this,  the  constant  bj  of  the  mask  is  set  appropriately. 


(2v0v2T2/cR0)n2  *  (bjAj^/xln2  — 


-b,  = 


2v0v2Tjx 
cR„ 


Zvo^T2 

cR„ 


(2R0  v„/c) 


4v<,vjT2v0 

-TIT 


(B3) 


Equation  (B3)  and  the  value  we  previously  chose  for  u0  provide  all 
the  information  necessary  to  construct  the  mask  that  is  used  in  the 
system.  Equation  (B3)  is  substituted  in  Eq.  (B2),  and  all  inconse¬ 
quential  phase  termsare  included  in  the  parameter  $.  Equation(B2) 
then  reduces  to  the  following  equation: 

Q(x.y)  =  (Bu#rr0/2)sinc[br/irvo(x-2R0va/c)] 

N 

X  2  A(nT)  cos  ^m^x+fdirv^T^cAyRo) 
n 

X  (y-(n0Ay/vT)4NAy)n  +  *]  •  (B4) 

The  summation  over  n  in  Eq.  (B4)  is  recognized  as  the  discrete  cosine 
transform1’  of  the  antenna  pattern  A(nT).  In  order  to  get  an  approx¬ 
imate  result,  we  can  assume  that  the  antenna  pattern  is  so  broad  in 
the  azimuth  direction  that  its  main  lobe  uniformly  illuminates  a 
distance  vN'T  on  the  ground.  Therefore,  A(nT)  is  approximately  a 
constant  for  0>n>N,  and  Eq.  (B4)  can  be  evaluated  as  follows1’: 


Q(x.y)  =  (Bvorr0/2)  sine  [(br/ nv0)  (x-2R0vo/c)] 

sin  [(2N»rv0v2T2/cAyR0)  (y-(q0Ay/vT)  +  NAy)] 
sin  [(2rrv0v2T2/cAyR0)  (y-(q0Ay/vT)  +  NAy)] 

X  cos  (4rru0x  +  4>)  .  (B5) 

The  ratio  of  the  sines  in  Eq.  (BS)  can  be  approximated  by  a  sine 
function  for  large  N,  and  this  leads  us  to  the  Anal  form  of  Eq.  ( 1 5): 

Q(x,y)  =  (NBvarr0/2)  sine  [(br/»rv0)  (x-2R1)vll/c)] 

X  sine  [(2Nv0v2T2/cAyR0)  (y-(qeAy/vT)  +  NAy)] 

X  cos  (4jru0x  +  d>)  .  (15) 
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ABSTRACT 

The  principles  of  operetion  of  the  Acousto-optic/CCD  reel-time  SAR  processor  ere  re¬ 
viewed  end  experimental  results  ere  presented.  The  interferometric  detection  method  used 
in  this  system  is  elso  discussed. 

I.  INTRODUCTION 

Synthetic  Aperture  Rsder  (SAR)imeging  the  first  problem  to  which  opticel  com¬ 

puters  were  successfully  applied,  initially  in  the  lete  5 0's.  The  requirements  of  modern 
rsders  such  es  real-time  image  formation,  better  image  quality  end  on-board  processing 
capability,  cannot  be  met  by  the  film  based  optical  SAR  processors,  we  have  recently 
introduced  (3,4)*  technique  for  real-time  optical  SAR  processing  that  utilizes  an  acousto¬ 
optic  device  (AOD)  as  the  input  electronie-to-optical  transducer  and  a  CCD  image  sensor  on 
which  t.ie  SAR  image  is  formed.  The  advanced  (and  continuously  improving)  state-of-the-art 
of  AOD's  and  CCD's  results  in  a  system  that  is  relatively  compact,  power  efficient,  inex¬ 
pensive  and  flexible.  Therefore,  we  expect  that  this  processor  can  be  advantageous  over 
digital  systems  in  many  of  the  applications  of  SAR.  In  this  paper,  we  present  recent 
experimental  results  and  we  discuss  the  interferometric  detection  scheme  used  in  the  system. 

II.  TIME-AND-SPACE  INTEGRATING  PROCESSING 

SAR  is  a  2-D  signal  processing  problem  because  the  data  collected  by  the  radar  is 
essentially  an  unfocused  image  and  the  processing  required  in  a  2-D  linear  operation  that 
brings  this  data  into  focus.  AOD's  are  used  in  the  processor  described  in  this  paper  to 
convert  the  RF  signals  to  modulated  light  waves.  Since  AOD’s  are  1-D  spatial  light 
modulators  tie  will  first  discuss  how  2-D  processing  can  be  accomplished  with  1-D  devices. 
The  approach  we  have  selected  is  to  process  the  data  by  spatial  integration  in  one  of  its 
dimensions  and  by  temporal  integration  along  the  second  •  This  is  shorn  in  block 
diagram  form  in  Figure  1. 
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Figure  1.  Time -and -Space  Integrating  Processor  of  2-D  Signals 
Leu  f (x,y)  be  an  arbitary  2-D  function  to  which  we  wish  t§  apply  a  linear  operator  charac¬ 
terised  by  the  impulse  response  h.  The  processed  data  g(x,y)  is  in  the  form 


9(*,J)  -  //  f(x,y)  h  (x,ft,y,$)  dxdy. 


TO  compute  g,  the  function  f(x,y)  is  first  sampled  in  the  y  dimension.  If  f(x,y)  is  an 
image,  a  raster  scanning  TV  camera  can  be  used  to  perform  the  sampling.  In  SAR,  the  data 
is  already  sampled  by  the  pulsed  radar  waveform.  The  sampled  data  can  be  thought  of  as  an 
ensemble  of  M  one  dimensional  signals,  f(x,nAy),  where  N  is  the  number  of  samples  in  the  y 
direction  and  Ay  is  the  sampling  period.  Each  of  the  1-D  signals  is  sequentially  entered 
into  the  optical  system  through  the  AOD  and  processed  by  spatial  Integration.  At  the 
time  the  nth  line  is  at  the  input  plane  of  the  optical  system,  the  light  at  the  output  is 
modulated  by 


®n  b  (x,ft,nAy,$)  dx. 
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where  h  is  the  spatial  impulse  response  of  the  optical  system  and  (ft,?)  are  the  output 
co-ordinates.  g_(ft,?)  is  detected  and  stored  on  a  2-D  CCD  array.  The  different  lines  of 
data  are  sequentially  entered  in  the  system  and  the  corresponding  responses  accumulated  on 
toe  time  integrating  CCD.  The  charge  accumulated  on  the  CCD  after  all  N  lines  of  data 
have  been  processed  is  proportional  to 


«(**?>  •  I  /  f (x,nAy)  h  (x,ft,nAy,f)  dx. 
n»l 


(3) 


Eq.  (3)  is  essentially  identical  to  Eq.  (1)  with  the  continuous  variable  y  replaced  by  nAy 
and  the  integration  over  y  replaced  by  the  summation  over  n.  The  final  issue  that  has  to 
be  addressed  is  whether  an  optical  system  can  be  implemented  with  an  impulse  response 
h(x,ft,nAy,f) .  This  impulse  response  corresponds  to  the  most  general  2-D  linear  operation 
(Eq.  1) .  It  is  a  function  of  three  spatial  variables  and  it  must  be  updated  for  each  n 
(eacn  line  of  input-data) .  It  is  not  in  general  feasible  to  implement  an  optical  system 
with  a  controllable  impulse  response  in  this  form.  It  is  however,  possible  to  do  so,  for 
two  very  important  special  forms  of  the  function  hi  a)  if  h  is  shift  invariant 
(h(x,ft,nAy,£)  -  h(x+ft,?+nAy) ,  2-D  convolution/eorrelstion  can  be  implemented.  (*'b)  if  h 
is  separable  in  x  and  y  (h (x,ft,nAy .?)  ■  hi  (x,ft)  h2  (nAy,?)),  operations  such  as  the  2-D 
Fourier  Transform  can  be  performed'5) .  The  signal  processing  required  for  EAR  image 
formation  is  also  a  2-D  linear  operation  with  a  separable  kernel  and  therefore  the  time- 
and-space  integrating  processing  method  is  applicable  to  this  problem. 

ZXZ.  EAR 

The  geometry  of  the  side-looking  radsr  is  shown  in  Figure  2.  The  vehicle  that  collects 
the  BAR  data  is  flying  with  constant  velocity  in  the  direction  x  parallel  to  the  ground. 
Coded  pulses  are  transmitted  by  the  antenna  mounted  on  the  vehicle  and  a  portion  of  the 
ground  is  illuminated.  The  reflections  from  the  ground  are  detected  at  the  vehicle.  The 
position  of  each  point  reflector  on  the  ground  in  the  y-direction  (range)  in  Figure  2  is 
estimated  by  measuring  the  round-trip  delay  of  the  radar  pulses.  The  position  of  each 
target  in  the  x-direction 


Figure  2.  BAR  Geometry 

(azimuth)  is  determined  by  measuring  the  Doppler  frequency  shift  of  consecutive  radar 
pulses.  As  the  vehicle  approaches  a  stationary  point  reflector  the  relative  velocity 
component  results  in  a  blue  Doppler  shift  on  the  reflected  pulses.  When  the  vehicle  crosses 
over  the  reflector  there  is  no  relative  velocity  component  and  no  frequency  shift  and  when 
the  vehicle  flies  away  from  a  red  Doppler  shift  results.  The  signal  processor  estimates 
the  range  and  Doppler  parameters  of  the  reflected  signals  for  all  points  on  the  ground 
simultaneously,  to  form  a  complete  BAR  image.  The  reflected  radar  signals  in  BAR  are 
normally  thought  of  as  a  2-D  data  set.  The  first  dimension,  n,  is  formed  by  the  time 
history  of  each  reflected  pulse  and  the  second  dimension,  ( ,  is  formed  by  the  consecutive 
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radar  pulses.  Xt  can  ba  shown  (2)  that  tha  signal  reflected  from  a  single  point 
reflector  located  at  co-ordinates  (x»x ,  y*y_ )  on  the  ground ,  arranged  in  tne  2-D  format 
is  given  byt 


an  by  t 

*  »2  ">-».>*  . 

k,  and  k,  are  constants  determined  by  the  para 


share  k,  and  k,  are  constants  determined  by  the  parameters  of  the  radar  and  we  have  assumed 
tnat  tne  transmitted  pulses  are  linear  frequency  modulated  (IFM) .  Zf  the  function  in  Eq. 
(4)  is  recorded  as  a  2-D  optical  transparency,  an  asymmetric  cone  plate  is  formed.  The 
image  of  the  point  reflector  on  the  ground  is  formed  by  focusing  this  rone  plate.  The 
focusing  operation  is  described  mathematically  by  the  following  2-D  integral} 


9(x,y> 


ff  -Jk.  u*x)2/y  -jk2 

- JJ  fU,n>  e  1  e  2 


#  t*02-*2)/ye  #  <ye2-y2> 


Urn  'j2kl  UX*Xo>/yo  .  *j2k2T’  (y-yo> 
*1*2 


(xo2-*2)  >jk2 


<yc2-y2> 


A.  is  the  interval  of  integration  in  the  aximuth  ( C )  dimension  and  it  is  proportional  to 
the  number  of  radar  pulses  that  are  integrated  to  form  the  SAR  image.  A,  is  the  interval 
of  integration  in  the  range  (n)  dimension  and  it  is  determined  by  the  duration  of  the 
transmitted  coded  pulses.  Eq.  (5)  demonstrates  that  the  image  g(x,y)  for  a  single  point 
target  is  a  focused  spot  centered  at  the  co-ordinates  (x  ,y  ).  Since  the  operations 
involved  are  linear,  the  entire  image  is  formed  for  an  afbitary  ground  reflectivity.  The 
signal  processing  required  is  described  by  Eq.  (5) ,  and  it  is  important  to  notice  that  the 
kernel  of  this  operation  is  separable  in  n  end  (.  He  rewrite  Eq.  (5)  in  order  to  emphasize 
this  point. 


i(x,y)  *  f  f(tfn) 


-jk2(n+y)' 


-j^U+x^/y 


h(C,y) 


U«*)Vy 


This  separability  allows  us  to  process  the  radar  data  f((,n)  first  along  the  range  (n) 
dimension  for  eseh  value  of  the  parameter  {.  Since  £  corresponds  to  different  radar  pulses, 
the  reflection  received  for  each  transmitted  pulse  is  processed  in  n  (the  time  history  of 
eaeh  return)  to  focus  the  SAR  image  in  range.  The  range  focused  image  is  then  processed 
across  the  consecutive  pulse  returnr  (£)  to  produce  the  final  image.  The  required 
processing  operation  in  (,  depends  on  y  and  therefore  a  different  processing  operation  must 
be  performed  for  each  position  in  range.  For  real-time  image  formation,  an  array  of 
parallel  processors  is  needed  in  the  azimuth  direction,  one  for  each  range  resolution  cell. 
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K«  present  the  range  processor  in  the  following  section  end  the  azimuth  processor  in 
section  V.  The  interferometric  detection  that  is  necessary  to  integrate  the  two  processors 
into  a  complete  SAX  imager  is  discussed  in  section  VI. 

IV.  RANGE  PROCESSOR 

A  schematic  diagram  of  the  range  processor  is  shown  in  Figure  3.  Recognizing  the  fact 
that  the  (  dimension  is  sampled  by  the  pulsed  radar  waveform,  we  replace  (  with  the  discrete 
variable  nA(,  where  n  is  an  integer  and  AC  is  proportional  to  the  pulse  repetition  period 
of  the  radar.  The  received  signal  f(nA(,n)  is  applied  to  the  AOD  and  the  system  is 
illuminated  with  a  pulsed  light  source.  The  FRF  of  the  light  source  is  equal  to  the  FRF 
of  the  radar.  The  timing  of  the  light  pulses  is  set  such  that  they  occur  at  the  Instant 
the  acoustic  signal  in  the  AOD 


Figure  3.  Range  Processor 

corresponds  to  the  reflected  signal  for  each  radar  pulse  that  is  transmitted.  This 
acoustic  signal  in  the  AOD  consists  of  a  multitude  of  spatially  misaligned  LFM  signals. 

Each  LFM  causes  a  portion  of  the  incident  light  beam  to  be  diffracted  into  a  diverging 
spherical  wave  that  is  focused  by  lens  L-  in  Figure  3.  The  position  in  the  y-dimension  at 
which  the  light  from  each  LFM  is  focused  at  the  output  plane,  is  proportional  to  the 
position  of  the  LFM  in  the  AOD  at  the  instant  the  light  source  is  pulsed.  This  position 
is  in  turn  proportional  to  the  range  of  each  target  on  the  ground;  reflection  from  targets 
relatively  close  to  the  radar  are  received  earlier  and  propagate  relatively  farther  in  the 
AOD  at  the  instant  the  light  source  is  pulsed.  The  focusing  action  of  the  lens  is 
described  mathematically  by  the  integral  over  r\  in  Eq.  (6)  and  the  output  of  the  processor 
in  Figure  3  is  the  EAR  image  focused  in  range  only. 

The  range  processor  described  above  has  been  assembled  and  tested.  The  experimental 
set-up  is  shown  in  Figure  4a.  A  pulsed  laser  diode,  operating  at  830  nm  wavelenght,  .5 
watts  peak  power  and  pulse  width  50  nsec  wss  the  light  source  in  this  experiment.  A 
spherical  lens  was  used  to  collimate  the  light  from  the  laser  diode.  The  AOD  shown  in 
Figure  4a  has  40  MHz  bandwidth  and  10  usee  aperture.  Cylindrical  optics  were  used  to  match 
the  shape  of  the  light  beam  to  the  aperture  of  the  AOD.  The  signal  applied  to  the  AOD  is 
shown  in  Figure  (4b).  The  consecutive  LFM  signals  were  generated  by  a  Surface-Acoustic 
wave  device  at  a  10  XHz  FRF.  The  duration  of  each  LFM  was  €  usee  and  the  bandwidth  20  MHz 
for  display  purposes.  The  laser  diode  was  pulsed  at  the  same  FRF,  delayed  by  approximately 
IS  usee,  to  allow  the  signal  to  propagate  through  the  SAW  and  the  AOD.  The  light  diffracted 
by  the  AOD  was  brought  into  focus  with  a  381  mm  focal  langth  spherical  lens.  The  dif¬ 
fracted  beams  were  converging  in  this  experiment  and  the  focal  plane  was  found  approximately 
340  mm  after  tne  spherical  lens.  The  collimated  undiffracted  light  was  spatially  separated 
from  the  signal  beam  at  this  point  and  the  signal  was  detected  by  a  linear  detection  array. 
Thirty  light  pulses  were  Integrated  on  the  array  before  it  was  read-out.  The  signal  from 
the  deteetor  is  displayed  in  Figure  4c  and  it  shows  the  few  LFM  signals  compressed  and 
therefore  the  SAX  image  brought  into  a  sharp  focus  in  range. 
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V.  AZIMUTH  PROCESSOR 

The  range  focused  inage  Bust  be  processed  in  the  i  dimension  (over  nany  radar  pulses) 
to  produce  an  image  focused  in  both  dimensions.  An  electro-optic  processor  that 

utilises  a  2-D  CCD  detector  ia  used  for  this  purpose.  A  schematic  diagram  of  the  azimuth 
processor  ia  shown  in  Figure  5.  The  light  distribution  at  the  input  plane  P,  ia  the  same 
light  tnat  appears  at  the  output  of  the  range  processor  of  Figure  3.  A 
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Figure  5.  Azimuth  Processor 

Let  n(nA£,y)  denote  the  light  amplitude  at  P,  at  the  range  position  y  during  the  nth  radar 
pulse.  The  light  from  P_  is  collimated  in  tne  vertical  (x)  direction  and  imaged  in  y  onto 
plane  P2«  A  mask  is  placed  at  plane  P2  with  amplitude  transmittance 


-jM/y 

•  e 


This  is  the  kernel  function  in  the  azimuth  (()  direction  from  Eg.  (6).  The  complex  trans¬ 
mittance  function  is  implemented  by  writing  the  data  on  a  spatial  carrier.  The  light 
immediately  after  the  mask  is  modulated  by  the  product  h(nA£,y)  t„(x,y).  Plane  P-  is 
imaged  in  both  dimensions  onto  plane  P,,  where  the  2-D  CCD  array  is  placed.  The  fight 
incident  on  the  CCD  is  inter ferometrically  detected.  The  entire  charge  pattern  stored  on 
tne  array  in  shifted  by  one  pixel  in  the  x-direction  after  each  light  pulse.  In  other 
words,  tne  CCD  vertical  transfer  rate  is  also  equal  to  the  radar  PRF.  The  photogenerated 
cnarge  due  to  consecutive  light  pulses  continues  to  accumulate  on  the  travelling  charge- 
pattern  in  the  CCD.  The  relative  motion  between  the  charge  on  the  CCD  and  the  fixed  mask 
provides  the  mechanism  by  which  the  correlation  between  the  input  h(nA£,y)  and  e  -jk2*2/y 
(tne  transmittance  of  the  nask)  is  computed  at  each  range  position  y.  The  charge 
accumulated  on  the  CCD  after  N  radar  (and  light)  pulses  is  given  by  M) 


M  -jk. 

I  h(nA£,y)e  * 

n-1 


(x+nAC-NAt)  ‘ 


-  g  (x-NA(,y), 


We  recognize  by  inspection  of  Eq.  (6),  that  Eq.  (S)  is  the  focused  SAR  image  shifted  in  the 
x  direction  by  NA£.  The  number,  N,  of  pulses  that  are  integrated  to  form  the  SAR  image  is 
equal  to  the  number  of  pixels  of  the  CCD  in  the  x  direction.  Therefore,  the  shift  in  x  by 
M  pixels  reveals  the  fact  that  tne  lines  of  the  focused  SAR  image  form  sequentially  at  the 
bottom  row  of  the  array,  where  they  are  transferred  to  the  output  shift-register  and  read¬ 
out.  The  lines  of  the  image  (slices  along  the  range  dimension)  are  continuously  produced 
at  a  rate  equal  to  tne  PRF  of  the  radar. 

A  photograph  of  the  experimental  azimuth  processor  is  shown  in  Figure  6 .  A  light 
emitting  diode  (LED)  was  used  as  the  source  in  this  experiment.  The  LED  was  temporally 
nodulated  with  a  slow  varying  LFM 
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Figure  4.  a)  Experinwntal  tenge  Processor  b)  input  LFM  Signals 
c)  Focused  LFM  Signals. 
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Figure  €.  Experimental  (c> 

Azimuth  Processor 


Figure  7.  s)  Input  LFM 
Waveform  b)  Mask 
c)  Ambiguity  Function 


signs!  to  stimulate  the  variation  of  f(C*n)  in  C  (see  Eq.  (4).  The  bandwidth  of  this 
signal  (corresponding  to  the  Doppler  bandwidth)  was  30  Hz  and  its  duration  1  second.  This 
waveform  is  shown  in  Figure  7s.  The  light  from  the  LED  was  collimated  by  lens  L,  in 
Figure  f  and  it  illuminated  the  mask  shorn  in  Figure  7b  and  marked  M  in  Figure  6.  The 
mask  was  imaged  by  lens  L,  onto  the  CCD.  The  CCD  is  a  hurried  channel  device  with  512 
pixels  in  the  vertical  (shifting)  direction  and  320  in  the  horizontal.  The  CCD  was  clocked 
horizontally  at  .5KHs.  Therefore  each  charge  packet  that  reached  the  output  stage  at  the 
bottom  of  the  device  had  accumulated  charge  for  (512)  x  2  msec  ■  1.024  seconds,  which  was 
approximately  equal  to  the  duration  of  the  input  LFM  signal.  The  transmittance  of  the 
mask  in  Figure  7b  is  a  LFM  signal  in  the  vertical  direction  and  the  FM  rate  varies  along 
the  y  direction.  The  signal  clocked  out  from  each  column  of  the  CCD  in  the  correlation  of 
the  temporal  signal  that  modulates  the  LED  and  the  transmittance  of  the  mask  in  the 
vertical  direction.  The  output  of  the  CCD  at  selected  horizontal  pixel  locations  is  shown 
in  Figure  7c.  A  match  between  the  input. wave form  and  tha  transmittance  of  the  mask  was 
obtained  et  the  middle  of  the  array  (pixal  #0)  where  we  obtain  the  autocorrelation  of  the 
LFM.  The  signals  at  other  locations  are  the  cross-correlation  of  the  LFM  with  scaled 
versions  of  Itself.  The  entire  2-D  waveform  is  known  as  the  ambiguity  surface  (10'  and 
the  familiar  tilted  ridge  structure  of  the  ambiguity  function  of  the  LFM  is  evident  in 
Figure  7e. 

VI.  IMTERFEROHETRIC  DETECTION 

The  overall  EAR  processor  is  synthesised  by  interfacing  the  range  and  Azimuth  processors. 
This  interface  however  must  be  coherent  because  the  information  needed  to  focus  the  BAR 
image  in  azimuth,  is  encoded  in  the  phase  of  the  range  compressed  signals  (the  Doppler 
frequency  shift).  Therefore  the  phase  of  the  light  must  be  recorded  on  the  CCD  as  well  as 
the  amplitude.  This  can  only  be  accomplished  by  introducing  a  reference  beam  so  that  the 
phase  can  be  recorded  on  the  interference  pattern.  Interferometric  detection  will  in 
general  decrease  the  dynamic  range  and  the  available  space-bandwidth  product  and  it  imposes 
stricter  requirements  for  mechanical  stability  and  coherence  of  the  source.  In  this 
section  we  describe  the  interferometric  detection  scheme  we  use  in  the  BAR  processor  that 
minimises  most  of  these  problems  and  we  report  experimental  results  of  interferometric 
detection  with  pulsed  laser  diodes. 
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The  Interferometric  system  is  shorn  in  Figure  t.  2t  is.  similar  to  the  range  processor 
shown  in  Figure  5.  Zn  this  ease  however,  the  radar  signal  after  it  is  nixed  to  the  center 
frequency  wk  of  the  AOD  it  is  added  to  a  reference  sinusoid  at  a  frequency  «£. 


Figure  8.  Range  Processor  including  interferometric  detection. 

difference  frequency  («,-«, )/2v  is  chosen  to  be  equal  to  the  bandwidth  of  the  radar  wave¬ 
form.  The  combined  wavffofm  is  applied  to  the  AOD  and  a  pulsed  light  source  is  used  as 
before.  Tne  light  diffracted  by  the  AOD  consists  of  two  separate  waves:  a  converging  wave 
due  to  tne  LFM  radar  signal  and  a  collimated  beam  due  to  the  reference  signal  at  w_.  Lenses 
L-  and  L,  are  separated  by  the  sum  of  their  focal  lengths.  This  arrangement  collimates  the 
plane  wade  reference  after  L,  and  it  images  the  focal  plane  of  the  LFM  signal  onto  the  CCD. 
The  temporal  frequency  offset  between  the  signal  and  the  reference  results  in  an  angular 
offset  between  the  focusing  signal  and  the  collimated  reference  that  are  co-incident  on  the 
CCD.  The  interference  pattern  is  recorded  on  a  spatial  carrier  and  it  can  be  separated 
from  the  bias  terms  by  filtering.  This  frequency  offset  however,  also  introduces  different 
Doppler  frequency  shifts  on  the  two  diffracted  beams,  which  can  wash  out  the  fringes 
when  many  pulses  are  integrated  on  the  detector  .  This  is  avoided  by  locking  the 
difference  frequency  |u,-w_f/2*  to  the  FRF  of  the  laser  diode.  He  show  some  of  the  inter- 
ferometrically  detectedAsignals  using  this  method,  in  Figure  9.  The  optical  system  shown 
in  Figure  •  was  assembled  and  a  LFM  test  signal  with  20  MHz  bandwidth  was  applied  as  the 


(a)  (b)  (c) 

Figure  9.  Znterferometrically  detected  waveforms  using  a  pul sea  laser  diode 
source. 

radar  signal.  The  reference  signal  was  equal  to  the  center  frequency  of  the  LFM  when  the 
photographs  shown  in  Fig.  9  were  taken.  Figure  9a  shows  the  interference  pattern  at  the 
image  plane  of  the  AOD  where  the  diffracted  LFM  wave  (a  purely  phase  modulated  optical 
beam)  is  Interfered  with  the  reference  beam.  The  LFM  is  reconstructed  at  baseband. 

Figure  9b  shows  the  interference  of  the  focused  LFM  and  the  reference  beam.  In  this 
instance,  destructive  interference  is  observed.  When  a  phase  delay  160*  is  Introduced 
electronically  in  the  reference  beam,  the  interference  becomes  constructive.  (Fig.  9c). 
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Thtu  results  srs  very  encouraging  since  the  pulsed  laser  diode  used  in  this  experiment 
(pulse  width  "  50  nsec,  PRF  •  10  KHz  is  designed  for  a  high  peak  power  (1.5  watts)  and 
consecutively  it  has  a  very  short  coherence  length.  Our  ability  to  obtain  strong  inter¬ 
ference  away  from  the  image  plane,  demonstrates  that  the  introduction  of  the  reference 
beam  through  the  same  Bragg  cell  as  the  signal  beam,  minimizes  the  coherence  requirements 
because  the  optical  paths  of  the  two  beams  are  equalized  very  effectively. 
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*»STRACT 

An  optical  processing  technique  la  preaentad  that  allows  the  processing  of  laages  using  an 
acousto-optic  device  as  the  input  light  aodulator. 

I.  INTRODUCTION 


laage  Processing  is  one  of  the  aost  proaislng  applications  for  optical  coaputers  because  the 
aultldiaenalonal  processing  apace  and  the  parallelism  of  the  optical  ays ten  can  be  very  effectively 
utilised  to  represent  and  perform  computations  on  laages.  The  practical  realisation  of  optical 
laage  processing  systems  however,  has  been  lapeded  by  the  alow  development  of  real-tlae  2-D  spatial 
light  aodulators  (SIM).  Such  devices  are  used  in  a  conventional  optical  laage  processor,  to  create 
at  high  apeed  a  transparency  corresponding  to  an  input  laage.  In  a  coherent  optical  coaputer  good 
optical  quality  of  the  SLM  is  essential  as  well  as  spaed  and  resolution.  A  number  of  2-D  SIM's 
have  been  under  development  for  several  years  11),  but  none  of  these  devices  have  yet  reached  a 
nature  state  of  development  that  would  allow  its  routine  use  in  image  processing  aysteas.  In  this 
paper  we  consider  the  implementation  of  optical  image  processors  using  an  Acousto-Optic  Device  (ADD) 
as  the  input  SLM.  AOD'a  arc  excellent  light  modulators  and  are  coanonly  used  to  optically  process 
1-D  signals  12].  The  relative  disadvantage  of  AOD'a  la  that  they  can  only  produce  light  modulation 
along  one  spatial  dimension.  Thus,  if  an  AOD  is  to  be  used  as  the  input  transducer  to  an  image 
processing  aystem,  we  must  find  ways  to  represent  2-D  functions  through  a  1-D  device  and  design 
optical  processor  architectures  that  can  process  the  images  as  they  are  represented  by  the  AOD. 

In  Section  11,  we  discuss  the  general  concepts  relating  to  the  representation  and  processing 
of  laages  using  AOD'a.  In  Section  111,  we  describe  the  implementation  of  2-D  linear,  shift  invariant 
operations  and  in  Section  IV,  we  discuss  the  implementation  of  2-D  linear  operations  with  separable 
kernels. 

II.  GENERAL  CONCEPTS 

Optical  image  processing  systems  typically  perform  linear  operations  on  the  input  laage  f (a,c) 
which  can  be  described  by  a  superposition  integral: 

gCl.T))  -  //  f(a.B)  h(n,B.C,Ti)dad£,  (1) 

where  h  is  the  impulse  response  of  the  linear  operation  and  g(C,n)  la  the  processed  image.  We  will 
address  two  related  issues:  a)  bow  will  the  function  f(o,6)  be  entered  in  the  optical  system  through 
the  AOD,  and  b)  what  is  the  optical  system  architecture  that  can  implement  Equation  (1). 

A  acheaatlc  diagram  of  an  AOD  la  shown  in  Figure  1.  The  device  consists  of  a  piezoelectric 
transducer  bonded  onto  the  acouato-optlc  crystal.  An  electronic  signal  applied  to  the  piezoelectric 
transducer  Induces  an  acoustic  wave  which  propagates  along  the  a-directlon  in  the  crystal  with 
acoustic  velocity  v.  When  the  device  is  lllmlnated  with  a  collimated  light  beam,  a  portion  of  the 
incident  light  la  diffracted  due  to  the  acousto-optle  interaction.  The  aaplitude  of  the  light 
diffracted  in  the  first  order  is  modulated  by  rect(y)  s(t+p),  where  s(t)  is  the  electronic  signal 
applied  to  the  device  and  A  is  the  aperture  of  the  device.  In  other  words,  at  any  instant  in  time 
t  the  aaplitude  of  the  diffracted  light  is  spatially  nodulated  by  the  signal  s(t)  for  t  <t<t  *  — . 

The  space-bandwidth  product  of  the  device  is  N  •  §  X  where  B  is  the  teapora)  bandwidth.  °For  a 
typical  AOD,  N  la  10*  -  10*.  For  the  majority  of  image  processing  appll. .  »ns,  the  input  laage  has 
a  space-bandwidth  product  of  (500)*  or  more.  Thus,  an  AOD  ean  only  represent  approximately  one  line 


Figure  1.  Acousto-optic  Spatial  Light  Modulator 


of  an  input  iaage  f(a,B)  at  one  time.  Since  the  AOD  Bust  be  addressed  electronically,  the  image 
f(a,B)  is  converted  to  an  electronic  signal  by  a  scanning  sensor,  such  as  a  TV  camera.  The  raster 
acanned  signal  s(t).  is  related  to  f (a,B)  by  the  following  relation: 

M 

e(t)  -  flv^ft-nTJ.nAyJ  (2) 

•here  v  is  the  scanning  velocity  of  the  TV  camera  in  the  a  direction,  Ay  is  the  resolution  of  f (a,£) 
in  the  I  direction,  T  is  the  duration  of  each  raster  line  (Tv,  is  the  else  of  the  image  in  the  a 
direction),  n  is  an  integer  and  N  is  the  total  number  of  raster  lines  in  the  B  direction  (Niy  is  the 
else  of  f(a,6)  in  the  B  direction). 

If  an  AOD  is  driven  hr  the  signal  la  Equation  (2)  the  diffracted  light  is  modulated  propor¬ 
tionally  to 


i(t+^)  •  j  f  Iv,<t"*^  -  nT),n£y]  rect(j). 


(3) 


The  light  source  illuminating  the  AOD  is  pulsed  at  time  instances  t-nT.  If  the  light  pulse  is  made 
shorter  than  the  Inverse  of  the  bandwidth  of  s(t),  at  time  t-nT  the  diffracted  light  is  modulated  by 


a(nT  +  i)  -  f (x.nAy) 


(A) 


In  Equation  (A)  we  assume  v.-v  for  simplicity  and  Tv,-A.  From  Equation  (A)  we  conclude  that  at  each 
instant  t-nT  the  AOD  spatially  modulates  the  light  with  the  nth  raster  line  of  f(a,B)  and  the 
different  lines  are  entered  consecutively  in  time.  For  a  fixed  position  x-x0  in  Equation  (A),  the 
light  is  temporally  modulated  by  the  function  f(x_,0),  sampled  in  0.  In  essence,  one  of  the 
dimensions  of  f  (a,0)  is  represented  in  one  spatial  coordinate  of  the  optical  system  and  the  second 
in  time.  The  representation  of  f(a,B)  by  the  AOD,  suggests  that  a  combination  of  spatial  and  temporal 
imtegration  must  be  need  la  any  optical  processor  that  would  process  an  iaage  represented  in  this 

If  the  sampling  in  the  0  direction  is  done  at  the  Nyquist  rate,  we  can  rewrite  the  expression 
of  a  general  2-D  linear  operation  (Equation  (1))  in  terms  of  the  signal  in  Equation  (A). 

■ 

*(C,n>  •  J.J  /  f (x,nAy)  h(x,nAy,(,n)dx 


(5) 


Ilact  the  Index  n  In  Equation  (4)  represents  different  instances  in  tine,  the  sismatlon  over  n  in 
Equation  (5)  can  be  implemented  in  an  optical  processor  by  tine  integration  on  a  detector.  There¬ 
fore,  we  turn  our  attention  to  the  optical  Implementation  of  the  Integral  in  x  in  Equation  (5). 

Per  each  value  of  n,  this  lntegrel  repreeente  a  linear  aye ten,  with  a  one-dimensional  input 
function  and  a  three-dlaenslonal  impulse  response.  The  optical  lnplenentatlon  of  auch  a  aysten  is 
in  general  difficult,  because  three  Independent  dlnenaions  are  required  and  we  only  have  two  spatial 
dimensions  to  work  with.  However,  the  implementation  is  possible  for  several  forms  of  the  function 
h(a,6,(,ri).  Specifically  if  b  la  shift  invariant  (l.e.,  h(a,B,(,T|)  -  h((-a,h-B)  or  separable  in  a 
and  ft,  (l.e.,  h(a,6,(,n)  ■  h1(a,(),  hjffi.n))  it  la  possible  to  configure  optical  processor  architec¬ 
tures  that  can  Implement  Equation  (5).  These  two  cases  are  very  significant  because  in  practice  the 
majority  of  the  linear  operations  that  are  cononly  performed  on  imagery,  are  indeed  shift  invariant 
or  separable.  In  the  following  sections  we  describe  the  implementation  of  acousto-optic  systems 
that  perform  image  correlation  and  Fourier  transformations. 

111.  SHIFT  IHVARIAHT  OPERATIONS 


For  a  shift  invariant  system.  Equation  (5)  can  be  rewritten  as  follows. 

N 

g((,n)  -  /  f (x.nAy)  h(C-x,T>-nAy)dx 

N 

•  /  l/f (x.nAy)  h((-x,ti)dx]6(n-fi  ♦  nAy)dfi,  (6) 

where  6(  )  is  the  impulse  function. 

For  each  value  of  the  integer  a,  the  term  in  the  brackets  in  Equation  (6)  is  the  l-D  convolution 
of  f (x.nAy)  with  h(x,ff)  for  all  values  of  the  independent  variable  f). 

An  optical  lnplenentatlon  of  auch  a  multichannel  l-D  convolver  is  shown  in  Figure  2. 

The  light  in  plane  P j  is  modulated  by  an  ADD  along  the  x-directlon  by  f (x.nAy).  The  light  is 
collimated  in  the  direction  orthogonal  to  x  by  lens  and  Fourier  transformed  by  L2  along  the 
■-direction.  The  amplitude  of  tu?  light  illuminating  plane  Fj  is  uniform  in  the  A  direction  and  is 
modulated  by  the  Fourier  transform  of  f(x,nAy)  in  the  horltontal  direction.  The  filter  function 
h(x,f|)  is  Fourier  transformed  along  x  only  and  a  hologram  of  this  transform  is  formed.  The  hologram 
is  placed  in  The  light  at  each  position  A  *  Ao  Immediately  following  the  hologram  is  modulated 
by  the  product  of  the  transforms  of  h(x,^Q)  and  f (x.nAy).  The  cylindrical  lens  L4  retransforms  this 
product  in  the  x-dlrectloo  and  lens  L«  Images  plane  Pj  onto  plane  F3  in  the  A  direction.  The  light 
is  detected  interferometrlcally  by  a  2-D  detector  at  the  output  plane  P3.  At  each  location  A0  in 
Pj  the  detected  signal  is  modulated  in  the  x-dlrectlon  by  the  convolution  of  the  function  f (x.nAy) 
and  h(x,(|p).  In  other  words,  the  light  distribution  at  the  output  plane  Pj  is  the  term  in  the 
brackets  in  Equation  (6).  According  to  Equation  (6)  this  function  must  be  shifted  in  the  A 
direction  by  mAy  and  the  stmmatlon  over  a  performed  to  obtain  the  output  g((,n).  The  vertical 
coordinate  on  the  detector  is  denoted  by  T)  to  distinguish  it  from  the  coordinate  in  the  sasie  plane 
associated  with  the  optical  system.  If  T)  »  (f-nAy  then  the  detected  signal  when  written  in  detector 
coordinates  ie  in  the  desired  form  and  the  emotion  over  a  can  be  simply  accomplished  by  letting 
the  signals  for  different  n  accumulate  on  the  time  integrating  detector.  He  therefore  focus  on  the 
interpretation  of  the  condition  n  ■  1^-nAy.  For  n«0  no  data  has  entered  the  system  yet  and  n  ■ 

i.e.,  the  coordinate  of  the  optical  systea  ant  he  detector  coordinates  coincide.  For  n»l, 

f)  ■  n-Ay  which  means  that  after  the  first  line  of  data,  f(x,Ay)  has  entered  the  system  and  the 
output  la  detected,  the  detector  must  be  shifted  in  the  n  direction  by  one  pixel.  In  general,  after 
each  line  aatars  the  systea  and  is  processed,  the  detector  is  moved  relative  to  the  optical  system 
by  00a  pixel,  la  practice,  this  relative  motion  can  be  achieved  by  mechanically  moving  either  the 
hologram  or  the  detector  relative  to  each  other  or  by  using  sa  optical  scanner  at  none  point 

between  the  hologram  and  detector  planes.  Most  conveniently  however,  a  CCD  camera  can  be  used  as 

the  detector,  la  a  CCD  the  photogenerated  charge  that  is  stored  in  each  pixel  can  be  shifted  to  an 
adjacent  pixel  by  applying  an  electrical  waveform  to  the  device  (4).  This  mechanism  is  normally 
weed  in  a  CCD  camera  to  read-out  the  detects  .  image  as  a  video  signal.  In  our  system,  the  charge 
transfer  mechanism  of  the  device  can  be  utilised  to  implement  the  shifting  of  the  detector 
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Figure  2.  Acousto-optic  Image  Correlator 

coordinate*  relative  to  the  re*t  of  the  system  In  a  very  convenient  and  efficient  manner. 

IV.  SEPARABLE  KERNEL  OPERATIONS 

If  the  function  h  la  of  the  form  b(a,B,£,T|)  -  h2(a,C)  h2(B,n)  then  Equation  (5)  can  be  written 

as  follow*: 


g(C.n)  ■  l/f(x,nhy)  hjU.tJdx]  h2(nAy,Ti)  (7) 

In  this  case,  the  2-D  processing  operation  reduce*  to  a  cascade  of  two  1-D  operations,  one  along  each 
dimension  of  the  Input  Image.  The  optical  architecture  that  Implements  Equation  (7)  Is  a  1-D  space- 
integrating  proceasor  operating  on  the  light  which  the  AOD  spatially  modulates  by  the  nth  line  of 
f (a, 6) ,  followed  by  a  time  Integrating  processor,  which  operates  In  the  orthogonal  dimension.  This 
can  be  accomplished  for  arbitrary  functions  hi  and  h2.  In  other  words,  2-D  apace  variant  operations 
can  be  Implemented  with  this  technique  If  the  kernel  Is  separable.  For  Instance,  a  2-D  Mellin  trans¬ 
form  which  la  useful  far  scale  invariant  Image  recognition,  can  be  calculated  in  real  tine.  There 
la  a  variety  of  optical  architecture*  with  which  Equation  (7)  can  be  Implemented  [5].  We  will 
resent  the  specific  example  of  a  particular  Implementation  of  the  2-D  Fourier  transform  In  order  to 
exemplify  the  signal  processing  method.  The  2-D  Fourier  transform  of  f(a,6)  is  given  by 


g(£,n)  -  S!  f (a,B)e 

•nd  in  the  ••spied  form  of  Equation  (7), 


dodS 


(8) 


-J2nat  #-j2*8n 


W 


*a.«) 


|  l/f (x.nAy)  «"j27IxtdxJ  «"J2l,nfiyT1 


(9) 


The  optical  architecture  that  can  implement  Equation  (9)  ia  shown  in  Figure  3.  The  raster 


Figure  3.  Acousto-optic  Image  Fourier  Transforming  System 

•canned  algnal  corresponding  to  the  input  image  la  applied  to  A0D1.  The  system  is  illuminated  wi <i 
a  pulsed  light  source  as  we  described  in  the  previous  aection.  During  the  nth  light  pulse,  the 
light  diffracted  by  A0D1  ia  f(x,nAy).  The  cylindrical  lens  Lj  collimates  the  light  in  the  direction 
orthogonal  to  x  and  1,  forms  the  Fourier  transform  of  f(x,nAy)  in  the  x-direction  and  displays  it  at 
plane  Ft.  A  second  ADD  la  placed  at  FJ.  The  acoustic  wave  propagates  in  the  direction  orthogonal 
to  a,  denoted  by  r)  in  Figure  3.  The  signal  r(t)  is  applied  to  A0D2,  where 


r 


r(t)  •  eoal(w0  4  ndw)t]  rectC^-^.) 


(10) 


Hhere  w  la  the  center  frequency  of  A0D2  and  Aw  is  a  fixed  frequency  increment.  The  amplitude 
o 
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of  th«  light  diffracted  by  1092  la  Modulated  by 


At  tlaaa  t-nT  and  assuming  tba  aperture  of  A0D2  la  equal  to  A-vT  the  Modulation  la 


,  /t-nT.  jnAvt  tefiffl  JV 
t(— )  eJ  eve 


a_ 

where  T  la  the  width  of  the  light  pulae  and  we  aaeune  T  «  We  alao  aet  T  ”  755.  The  light  after 
A0D2  la  Modulated  by  the  product  of  the  Fourier  tram  form  of  f(x,nAy)  and  Equation  (12): 


ract(£=Sl)  e*A  T%(L, n)  a  (13) 

where  T^,a)  •  /f(xanAy)  e^^^dx. 

Plane  Pj  la  inaged  onto  the  output  plane  Pj  by  the  apherlcal  lena  I3.  A  reference  plane  wave  la 
alto  made  Incident  on  plane  Pj.  The  aaplltude  of  the  reference  beam  la  nodulated  by 

2*ame  C  4u  t 

E(C.t)  -  - )T-  eJV-  <“> 

where  6,  li  the  angle  of  the  reference  Lean.  A  2-D  tine  Integrating  detector  la  placed  at  Pj.  The 
algnal,  t)(5,n,n),  detected  during  each  light  pulae  la  the  tine  Integrated  intensity  of  the  total 
light  amplitude  (the  aun  of  Equatlona  (13)  and  (14)). 

.2*nn 

D(C.ti.h)  -  /  |  T  «,n)erA  +  e3  X  |*  it 
T 

2naln6  t 

-  2T|FK«,n)|coaI - 4  ♦(C.n)]  (15) 

♦  Bias  terna. 

The  algnal  accumulated  on  the  detector  after  N  pulses  la  given  by: 

*  K  2italn6_C 

»(5.T»,n)  -  2  J.1|Fs«,n)  |coa[ - j—*-  -  ^1  «•  p(tan)] 


4  Bias  terms 


2i|g(C.®)|coal 


2taln6  £ 


4  d.CCin)}  4  Bias  terna 

1 


where  g(C(n)  •  |g(C,n)  |e^  g  la  the  2-D  Fourier  transform  of  f(a,6)  as  defined  In  Equation  (9). 
Thus  the  2-D  transform  forma  on  the  detector  on  a  epatlal  carrier  of  frequency  —  y  ft  and  it  can  be 
obtained  by  quadrature  demodulation  of  the  video  signal  when  the  detector  la  read-out. 

V.  COWaUPlWC  KEMARKS 

We  have  demonstrated  that  AOD'a  which  are  1-D  spatial  light  Modulators  can  be  used  to  represent 
2-D  Images  la  an  optical  processor  by  raster  scanning  the  Images  and  applying  the  video  algnal  to  the 
ADD.  The  use  of  a  pulsed  light  source  la  the  system  Isolates  e^ch  raster  line  from  the  rest.  A 
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Appendix  V f 


Mil  Tin*  Computation  of  Momenta  with  Acousto-optica 

Kelvin  Wagner  and  Demetrl  Fsaltls 

Department  of  Electrical  Engineering 
California  Institute  of  Technology 
Pasadena,  CA  91125 


Abstract 

The  separable  nature  of  the  geometric  moment  generating  functions  and  the  serial  raster 
encoding  of  the  image  permits  the  2-dimensional  moment  Integral  equation  to  be  computed  with 
a  cascaded  system  of  1-dimensional  integrations.  Zn  this  paper  new  optical  processing 
architectures  are  presented  that  use  acousto-optic  devices  illuminated  by  pulsed  sources  to 
enter  the  data  into  the  optical  system.  The  advanced  state  of  the  art  of  the  components 
used  and  the  flexibility  of  these  architectures  can  lead  to  the  implementation  of  practical 
optical  processing  system  for  computing  the  moments  of  a  real  time  high  resolution  image. 

Introduction 


Given  a  finite  image  intensity  distribution  f (x,y)  over  an  aperture  A,  the  p,qth 
geometric  moment  m  of  order  p+q  is  given  by  the  moment  integral  equation 

*****  "  **  *C«#y>  tody.  (1) 

The  value  of  these  geometric  moments  are  sensitive  to  the  position,  scale,  rotation  and 
contrast  of  the  image.  Appropriate  nonlinear  combinations  of  moments  can  be  made  invariant 
to  all  of  these  intraclass  variations.  1.2. 3, 5, 6,8  TheBe  invariants  may  have 

applications  in  pattern  recognition  as  a  low  dimensionality  feature  space  for  image  classi¬ 
fication4  and  in  coding  the  essential  features  of  an  image 8.  Alternatively  the  moments  can 
be  used  to  normalize  an  image*?  ao  that  intraclass  variations  are  minimized,  so  that  standard 
pattern  recognition  techniques  such  as  template  matching  can  be  applied  successfully.  The 
zeroth  order  moment  gives  the  average  of  f(x,y).  The  first  order  moments  locate  the  image 
centroid  x  m  ®l°/n^)0 ,  y  »  ol/s^.  The  central  moments  are  defined  with  the  centroid  as 

the  origin  and  are  Invariant  to  translations  of  the  image 

Ppq  -  y/(x-x)p  (y-y)9  f(x,y)  dxdy 

A 


©0  (-*)p-r 


(2) 


Dotation  and  scale  invariant  moments  of  order  (p,q)  can  be  defined  in  terms  of  the  ordinary 

moments  mr|. 

9*12 

Coherent  optical  processors  have  been  proposed  to  compute  the  moments  ,  using  2- 
dimensional  spatial  light  modulators  (SLM)  for  real  time  operation.  The  separable  nature 
of  the  geometric  moment  generating  functions  and  serial  raster  encoding  of  the  image  allows 
the  decomposition  of  the  moment  Integral  into  cascaded  1-dimensional  Integrations.  Mew  ' 
architectures  are  presented  that  use  1-dimensional  acousto-optic  (AOD)  spatial  light  modu¬ 
lators  tc  enter  the  data  into  the  optical  system.  Zn  the  first  architecture  the  separable 
snment , generating  function*!  are  entered  through  the  AOD’s,  which  allows  flexibility  in  the 
choice  of  generating  functions,  and  accuracy  of  their  representation.  Alternatively  the 
moment  generating  functions  can  be  written  on  film  or  used  to  modulate  the  optical  source 
and  the  raster  recorded  image  is  entered  into  the  optical  system  through  the  AOD.  The  large 
dynamic  range  and  rapid  programmability  of  acousto-optic  devices  can  allow  the  implementa¬ 
tion  of  practical  real  time  optical  computers  for  the  generation  of  the  geometric  moments  of 
an  image. 

Epace  Integrating  Processor 

Film  based  coherent  optical  processors  have  been  proposed  for  computing  the 

geometric  moments  of  an  image  using  the  2-D  spatial  Integration  performed  by  a  spherical 
Fourier  transform  (FT)  lens.  Teaaue's9  method  requires  multiple  differentiation  of  the  FT 
of  the  image.  The  other  methods  10.12  invoiVB  the  spatial  integration  of  the  product  of  the 
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lug*  f(x,y)  and  tha  Moment  generating  function  g  (x,y)  »  xp  y^.  Spatial  fraquaney 
Multiplexing  of  the  generating  functions  in  a  computer  generated  hologram  can  be  used  to 
compute  all  the  desired  moments  in  parallel  at  aeparate  locations  in  the  frequency  plane. 

Since  the  geometric  aement  generating  function  xp  y**  is  separable  in  cartesian 
coordinates,  we  can  replace  the  moment  mask  of  Ref.  10,11  with  a  pair  of  crossed  acousto- 
optic  deflectors  (AOD)  schlieren  imaged  onto  the  image  film  as  shown  in  Fig.  1.  This  is 
similar  to  a  triple  product  processor  architecture*  f ,  except  that  the  continuously  modulated 
source  is  now  pulsed.  Zf  the  pulse  width  is  less  than  the  Inverse  bandwidth  of  the  signals 
in  the  AODs,  then  it  will  act  as  a  delta  function  in  time  and  freeze  the  image  of  the 
moment  generating  function  when  it  illuminates  the  input  image.  The  functions  tp  and  t1* 
are  synchronously  applied  to  the  AODs  as  amplitude  modulations  to  an  RF  carrier  at  the 
center  frequency  of  the  AOD 


*1P 


S2q  (t) 


tP 

t9 


.  i 2  V 


(3) 


For  odd  powers  there  is  a  charge  of  sign  at  t*o  that  is  represented  with  a  180*  phase 
change.  This  will  lead  to  destructive  interference  at  the  integrated  output  which  can  be 
interferometrically  detected.  When  these  signals  simultaneously  slide  to  the  centers  of 
the  AODs  the  laser  diode  (LD)  is  pulsed,  collimated,  and  focused  into  a  horizontal  strip 
that  enters  AOD1  at  the  Bragg  angle.  The  diffracted  light  is  collimated  in  y  and  Fourier 
transformed  in  x  to  produce  a  vertical  strip  that  illuminates  A0D2  at  its  Bragg  angle.  Both 
undiffracted  components  are  filtered,  and  the  doubly  diffracted  light  is  expanded  in  x  to 
a  square  so  that  AOD1  is  imaged  onto  f(x,y)  in  the  -x  direction  and  A0D2  is  imaged  onto 
f(x,y)  in  the  -y  direction.  The  light  amplitude  Incident  on  the  image  is  similar  to  an 
outer  product  and  is  modulated  by 


(x.y.t)  -  «<t)  Slp  (x+vt)  S2q  (y+vt) 

•  8(t)  Slp  (x)  S2qCy)  . 


(4) 


This  is  multiplied  by  the  image  transmittivlty,  f(x,y),  and  the  product  is  Fourier  trans¬ 
formed  by  the  integrating  lens.  This  transform  can  be  sampled  at  its  center  or  integrated 
over  its  whole  extent  to  yield  an  interferometrically  detected  signal  proportional  to  the 
desired  moment. 

Mpg  mJf& ip<*)  s2q(y)  f(x,y)  dxdy  mffx P  y9  dxdy. 

A  A  (5> 

All  the  desired  moments  could  be  computed  successively  with  high  accuracy  and  dynamic  range 
on  a  single  detector  pair  very  rapidly.  For  an  AOD  with  a  1 Op  sec  aperture  time  moments 
through  the  tenth  order  could  be  computed  in  .5msec.  This  would  allow  many  differently 
windowed  sets  of  moments  to  be  computed  during  each  frame  time  of  available  2-D  spatial 
light  modulators.  Alternatively  the  moments  could  be  computed  simultaneously  with  lower 
dynamic  range  in  a  few  microseconds  by  using  temporal  frequency  multiplexing  of  the  moment 
generating  functions.  This  is  shown  in  Figura  2.  Zn  this  case  the  following  signals  are 
applied  to  the  two  AOD'a  of  the  system. 


8.  <t)  -  I  tp  a 

P-o 


8,  (t)  -  X  t9  a*2*  <fo+qAf)t  •  (6) 

q-o 

where  Af  la  the  frequency  aeparation  of  the  frequency  multiplexed  moment  generating  fuctions. 
For  an  image  bandwidth  B  [cy/mm]  and  acoustic  velocity  v,  the  different  moments  would  be 
spatially  separated  in  the  output  plane  if  Af/v>  B,  and  tharefore  could  be  sampled  by  an 
appropriataly  arranged  array  of  detectors. 

The  versatility  of  this  system  allows  the  direct  optical  computation  of  the  central 
momants  instead  of  the  geometric  moments  .  First  the  centroid  is  located  in  each 

dimension  separately  by  finding  the  oth  and  1st  order  moments  and  using  x  -  "l°/®oo* 
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y  ■  b  ./b  ,  or  by  operating  the  source  CM,  and  locating  the  aero  eroesing  of  the  detector's 

temporal  output  as  the  generating  functions  for  «1o  or  »ol  slide  through  the  Bragg  cells. 

To  compute  the  central  moments  directly  the  moment  generating  functions  are  input  to  AODl 
and  A0D2  with  a  relative  delay  ■  tj  -  ■  x/v  -  y/v  and  the  LD  is  pulsed  at  This 

aligns  the  origin  of  the  moment  generating  functions  with  the  image  centroid,  and  the 
spatially  integrated  outputs  compute  the  central  momenta  y„.  This  architecture  also 
allows  the  windowing  of  the  region  for  which  the  momenta  are  being  computed  by  simply 
windowing  the  electronic  signals  Si(t)  and  S^Ct),  this  would  allow  a  rapid  search  for  the 
appropriate  window  within  f (x,y)  to  be  made  under  computer  control. 

Space  and  Time  Integrating  Architecture 

The  performance  of  the  space  integrating  moment  processor  could  be  limited  by  the  2-D 
spatial  light  modulator  (SLM)  required  for  real  time  operation.  Zn  many  applications  the 
image  is  available  to  the  optical  processor  in  the  form  of  a  aerial  raster  signal.  Xn  this 
case,  the  2-D  image  f(x,y)  can  be  entered  into  the  optical  processor  one  line  at  a  time 
through  a  1-D  SLM  such  as  an  acousto-optic  device  (AOD)  13,14 (  The  raster  scanned  repre¬ 
sentation  of  a  continuous  image  f(x,y)  is  denoted  by  f(x,nAy)  where  n  is  an  integer  and  Ay 
is  the  separation  between  the  raster  lines.  The  moments  can  be  calculated  from  the  sampled 
image  by  replacing  the  integration  over  y  in  Eq.  (1)  with  a  summation  over  n 

stpq  •  I  (nAy )qf  x*  f (x,nAy)  dx.  (7, 

This  formation  suggest  a  hybird  space  and  time  integrating  system3®'15*33  as  shown  in  Fig. 

3.  The  video  raster  lines  are  sequentially  applied  to  an  AOD  operated  in  the  intensity 
modulation  regime  and  oriented  in  the  x  direction,  as  an  amplitude  modulation  of  an  RF 
carrier  at  the  center  frequency  of  the  piezoelectric  transducer.  The  AOD  is  illuminated  by 
the  collimated  light  emitted  from  a  closely  spaced  array  of  0+1  pulsed  modulated  laser 
diodes  (LD) .  If  all  the  LD's  emit  light  at  the  same  wavelength  then  the  spatial  frequency 
multiplexed  light  incident  on  the  AOD  must  be  within  its  Bragg  angular  aperture.  Alterna¬ 
tively,  the  momentum  mismatch  can  be  compensated  by  varying  the  wavelength  in  the  LD  array, 
so  that  the  light  from  each  LD  is  incident  on  the  AOD  at  the  Bragg  angle  for  that  wavelength. 
When  the  nth  video  raster  line  completely  fills  the  AOD  aperture,  the  entire  LD  array  is 
synchronously  pulsed  with  a  pulse  width  short  enough  to  freeze  the  image  of  the  raster  line 
within  the  AOD.  The  intensity  modulation  of  the  qth  LD  is  given  by 

*  o 

Iq(t)  -  t  (nq  ♦  bias)  6(t  -  nT) , 


where  T  ia  the  video  line  time  and  the  bias  may  be  needed  to  represent  the  bipolar  odd 
moment  generating  functions.  The  bias  is  not  necessary  for  the  even  moments  and  spatial 
multiplexing  can  be  used  rather  than  bias  to  represent  the  bipolar  odd  moments.  The  light 
diffracted  by  the  AOD  is  expanded  and  collimated  in  y  and  schlieren  imaged  in  x,  so  the 
intensity  incident  on  Fj  from  the  qth  LD  during  the  nth  raster  line  is 

Oj (x,t)  -  Xq(t)  fCt-  |,  nAy)  »  nq  6 It-nT)  f(|,  nAy).  (9) 

At  plane  Pj  a  mask  is  placed  containing  the  intensity  transmittance  variations  xp  at 
different  y  coordinates « 


t(x,y)  - 


J  rect 


R?] 


The  light  leaving  Pj  (modulated  by  the  product  of  the  incident  intensity  and  the  ssiK  trans¬ 
mittance),  ia  thefa  imaged  in  the  y  dimension  and  integrated  in  the  x  direction  onto  the  plane 
Fj  .  At  the  output  plane  there  are  ((HI)  columns  of  (F+l)  detectors  each.  Each  LD,  is 

imaged  onto  a  aeparate  column  and  to  avoid  crosstalk  the  columns  must  be  separated  by 
A>XFv/B,  where  F  is  the  focal  length  of  the  integrating  lens,  v  is  the  acoustic  velocity  and 
B  is  the  video  bandwidth.  If  the  detector  is  wide  enough  to  collect  all  the  light  from  its 
associated  laser  diode  then  the  detected  signal  on  the  p,q*h  detector  during  the  nth  pulse 
will  be  proportional  to 


tflj  t  (|,  nAy)  xp  dx 
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*„<»)  -  J<n^)T  lq(t)  j  xpdx  dt  - 


(11) 


Zf  'the  detector  is  tlM  integrated  for  a  full  video  frame  the  output  of  the  p,qth  detector 


xF  dx  dt 


J  xq(t,J  V*'*’ 

J  f(£,  nAyj  *p  dx 
Z  Jnq  xp  f  (£,  nAy)  dx. 


-  I  nq 
n*o 


t) 

Z 

n-o 
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which  la  proportional  to  the  desired  moment  calculation.  All  (P+1)  x  (0+1)  aoments  are 
•computed  in  parallel  on  a  2-dimensional  array  of  detectors. 

An  alternative  topology  of  the  optical  processor  is  obtained  by  spatially  multiplexing 
the  LDs  in  the  y  direction  aa  shown  in  Fig.  4.  This  elllminates  the  problem  of  Bragg  angle 
oismateh  previously  encountered,  and  allows  all  the  moments  to  be  detected  on  a  single 
linear  detector  array,  without  crosstalk.  The  mask  must  be  repeated  once  for  each  laser 
iiode  for  this  architecture  and  its  intensity  transmittance  la  given  by 


t (x,y)  «  Z  I  xp  rect  fr"* tp41 > Y0-PV0 

q-o  p-o  L  yD 

another  useful  feature  of  this  architecute  is  its  extension  to  bipolar  processing  as  shorn 
in  Fig.  5.  For  odd  q  two  laser  diodes  can  be  spatially  multiplexed  in  the  x  direction,  one 
represents  the  positive  and  the  other  the  negative  portions  of  the  moment  generating 
function.  Similarly  for  odd  p  two  rows  of  the  mask  are  used  to  represent  the  positive  and 
negative  portions  of  this  half  of  the  moment  generating  function.  Two  linear  time  integra¬ 
ting  detector  arrays  are  used  to  detect  the  four  cross  products.  The  outputs  are  electron¬ 
ically  added  and  subtracted  to  yield  the  calculated  bipolar  moment. 

uiscuealon 


1 


(13) 


In  optical  analog  computers  of  this  type  errors  and  noise  can  enter  into  the  calcula¬ 
tion  for  many  reasons.  These  Include  noise  in  the  modulated  laser  diode  sources,  non- 
linearities  in  the  acousto-optic  Bragg  cell,  quantisation  errors  and  film  nonlinearities  of 
•.he  computer  generated  masks,  optical  aberrations,  coherent  noise  and  detector  noise. 

Careful  optical  and  electronic  design  can  minimize  most  of  these  effects,  and  in  practice 
i-he  output  detector  array  is  a  major  factor  that  limits  the  accuracy  of  an  optical  computer, 
•ypical  charge  coupled  device  (C CD)  detector  arrays  have  an  output  SNR  of  lOOOsl,  which 
allows  a  digitisation  of  the  optically  computed  geometric  moments  to  a  resolution  of  10  bits. 
A  digital  post  processor  can  then  combine  the  geometrical  moments  to  produce  the  invariants 
and  perform  a  pattern  classification  based  on  the  invariant  feature  apace.  The  geometrical 
noment  optical  preprocessor  takes  the  bulk  of  the  computational  load  away  from  the  digital 
omputer ,  however  some  accuracy  is  sacrificed. 

The  separable  moment  generating  function  * p  is  positive  definite  for  even  powers  p, 
and  an  incoherent  unipolar  intensity  representation  can  be  used.  For  odd  powers  p,  the 
moment  generating  functions  become  bipolar.  Therefore  the  capability  to  represent  bipolar 
'Quantities  must  be  Incorporated  in  the  optical  processor.  Xf  coherent  light  is  used  the 
'cancellation  needed  for  odd  moment  powers  can  be  performed  in  the  space  integrating 
>roceaaors  by  destructive  interference  and  interferometric  detection.  Bowever  in  the  time 
Integrating  architectures  the  processing  is  performed  by  Integrating  photogenerated  charge 
on  the  detector,  which  is  proportional  to  the  number  of  Incident  photons  or  the  intensity 
and  therefore  strictly  positive.  Bipolar  operations  can  be  performed  by  placing  the  odd 
moment  generating  functions  on  a  bias.  This  in  turn  places  a  bias  on  the  detector  thereby 
decreasing  the  available  dynamic  range  of  the  computed  moments.  Alternatively  the  positive 
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and  negative  halves  of  the  eeparable  odd  ament  generating  functions  can  be  represented 
In  separate  channels  of  the  processor.  The  erossproduet  terns  Bust  be  electronically 
combined  with  the  appropriate  sign  when  the  deteetor  is  read  out  in  order  to  produce  an 
estimate  of  the  bipolar  moment.  The  achievable  accuracy  and  dynamic  range  of  this  bipolar 
estimate  will  be  limited  by  the  requirement  that  none  of  the  detectors  saturate,  and  that 
the  variances  of  the  noise  will  add.  The  possibility  of  a  special  puzpose  directly  coupled 
detector  structures  to  perform  the  continuous  subtraction  needed  for  incoherent  bipolar 
optical  processing  merits  further  research. 

Conclusions 

In  conclusion  we  have  proposed  several  optical  computing  architectures  for  calculating 
the  geometrical  moments  of  images  in  real  time.  The  space  integrating  processor  requires 
a  2-D  ELM  to  represent  the  luge,  but  has  the  flexibility  of  electronic  control  of  the 
separable  moment  generating  function.  With  this  processor  the  moments  can  be  calculated 
sequentially  at  a  rapid  rate  with  high  accuracy.  The  time  and  space  integrating  architec¬ 
tures  are  not  as  flexible  since  the  moment  generating  functions  are  fixed  by  the  computer 
generated  masks.  However  since  acousto-optic  devices  are  used  to  enter  the  raster  video 
data  into  the  optical  processing  system,  the  need  for  a  real  time  2-D  ELM  is  avoided. 
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Figure  4.  Time  and  space  integrating  moment  processor 
with  vertical  spatial  smltiplexing  of  the 
laser  diode  array. 


Figure  S.  Bipolar  representation  of  the  odd  moment 

generating  function  in  the  processor  of  Figure  4, 
By  horisontal  multiplexing  of  the  sources  and 
vertical  multiplexing  in  the  mask. 
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